2021-07-26T15:25:41.810 INFO:root:teuthology version: 1.1.0-b6f3efab 2021-07-26T15:25:41.813 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_sage@teuthology --verbose --archive /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838 --name sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi --description upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm supported-random-distro$/{ubuntu_latest} tasks upgrade/primary} -- /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838/orig.config.yaml 2021-07-26T15:25:41.855 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-07-26T15:25:41.922 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838 branch: wip-kefu-testing-2021-07-24-1158 description: upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm supported-random-distro$/{ubuntu_latest} tasks upgrade/primary} email: null first_in_suite: false job_id: '6293838' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-kefu-testing-2021-07-24-1158 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c2.client.1 is_pubsub: true name: test-zone3 rgw-multisite-tests: args: - tests.py - tests_ps.py branch: pacific repo: https://github.com/ceph/ceph.git workunit: branch: wip-kefu-testing-2021-07-24-1158 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e owner: scheduled_sage@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e sleep_before_teardown: 0 suite: upgrade suite_branch: wip-kefu-testing-2021-07-24-1158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e targets: smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mYLgQHG+4OHtOpcPVGk/r6+FAwkPgBjs5qMoPlQVe3igdN/iHazC9qWmzv7WDD+Iyx0KFs23aPBlseCDS67/RiXcbvgiyMWGUDjPT1aubQppJiiPgN1bjfBIoVDWVt6GT7y28EpV2bz5vOlMwKPo6K96sBaCWUwAAIwFPGZtxum82gLOnVyqvLVwPqNfUhY4YtkalF4/3SeTwqFYnyz1ZbsmQO+fhIdO3Zb0dotSb1/XhF/CqRCmtL2+4KoMPww7nEypzs2YqkvYZo4YqP5fn1qqjQ9y9pBUyRFga9rS5PpINWBx0mBo6rCxhTWVkEMLTbDR+uYH4M+mm1538Lf/xZZQ4ZVOJA90VomPgkgqVBPfuXtBjMe9/DkHFk2VTHCdBRX2HW+8P2NlOyayVJqmnps9zfT8XpI9V6ce+ptMkFWWZE59ORl31s8xLnWZH0ZsmpMHBIUUeRkmPM3iQhgxkSL8enD4wHOtZimtUqfoKkmRqGBa97PagzOLBWrtvns= smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzSKexTFHqtNZ7AxtWSSinQgeX1iKzjFCnKS4MNtilyXBe/u5uaC6Jo9NYwc33XacM0VOwG4gYlijpR5Eg5mwBflSQ/8b+Y8xNdamO1JjyMwftdcfzoTTO9aRZUkaCODx4TZTK01INqeBvMtJR/kzYg4rSH5NBxvCN8uHlOY5PKLU8FA9Y8qJuQbT2rTWp7+MHKNzzCxq0e1sDQ1EdiJvYfJKKmhHIDuO5E1q0t6B1teubqxJ6DkkUwCfSahA7GT43rFObI09WHnf08FcJY6TkPp0FcQXJwXYqTqLqd1etA4M2YvjOQJcVrAxcE2X0Dhe/d2qmcmbIGInRe7UXTEeJ3TMlxf87aFsRvXu+Czq/q2mflWiTQUYUB2OTVK5GEKUdh1EfRchd0OUtZsQ9AJj+YDXvMMLqc7tLXV5Vqfb0mWtysQJKs1CdIrragi2Lalm86/ncNGI+e5dTgdWm5B99mMunH2+mgh9ZMHONj3JYey5y+newLVeLPxu8pAFt/J8= tasks: - install: branch: pacific - ceph: cluster: c1 - ceph: cluster: c2 - parallel: - upgrade-task - rgw: c1.client.0: port: 8000 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: b6f3efab84b70e18e86ec271a07564aeb4ed3bac timestamp: 2021-07-26_15:05:01 tube: smithi upgrade-task: - install.upgrade: c1.client.0: null c1.mgr.x: null c1.mon.a: null c1.osd.0: null c1.osd.1: null c1.osd.2: null user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-07-26T15:25:41.923 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa; will attempt to use it 2021-07-26T15:25:41.924 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa/tasks 2021-07-26T15:25:41.924 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-07-26T15:25:41.926 INFO:teuthology.task.internal:Checking packages... 2021-07-26T15:25:41.945 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e' 2021-07-26T15:25:41.946 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:25:41.946 INFO:teuthology.packaging:ref: None 2021-07-26T15:25:41.947 INFO:teuthology.packaging:tag: None 2021-07-26T15:25:41.948 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-07-24-1158 2021-07-26T15:25:41.948 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:25:41.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-kefu-testing-2021-07-24-1158 2021-07-26T15:25:42.120 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:25:42.122 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-07-26T15:25:42.139 INFO:teuthology.task.internal:no buildpackages task found 2021-07-26T15:25:42.139 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-07-26T15:25:42.179 INFO:teuthology.task.internal:Saving configuration 2021-07-26T15:25:42.193 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-07-26T15:25:42.204 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-26T15:25:42.221 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:19:49.070111', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGGusaFPiAo/thOc3ykmmcX26YwFCGEHcoAUe17SEyNW', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi018.front.sepia.ceph.com'} 2021-07-26T15:25:42.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:19:49.070089', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH0rPhcEN+xEve1iSNfBXFg079kJ4gvIFEOBj3+YNWVl', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi111.front.sepia.ceph.com'} 2021-07-26T15:25:42.240 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-07-26T15:25:42.251 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2021-07-26T15:25:42.252 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-07-26T15:25:42.253 INFO:teuthology.run_tasks:Running task console_log... 2021-07-26T15:25:42.344 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9e59495d08>, signals=[15]) 2021-07-26T15:25:42.345 INFO:teuthology.run_tasks:Running task internal.connect... 2021-07-26T15:25:42.356 INFO:teuthology.task.internal:Opening connections... 2021-07-26T15:25:42.357 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:25:42.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:25:42.411 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:25:42.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:25:42.468 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-07-26T15:25:42.481 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2021-07-26T15:25:42.492 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2021-07-26T15:25:42.493 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2021-07-26T15:25:42.543 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2021-07-26T15:25:42.543 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:25:42.544 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2021-07-26T15:25:42.544 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2021-07-26T15:25:42.545 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:25:42.545 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="20.04" 2021-07-26T15:25:42.545 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:25:42.545 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:25:42.546 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:25:42.546 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:25:42.546 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=focal 2021-07-26T15:25:42.546 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:25:42.547 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2021-07-26T15:25:42.562 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2021-07-26T15:25:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2021-07-26T15:25:42.569 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2021-07-26T15:25:42.618 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2021-07-26T15:25:42.619 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:25:42.619 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2021-07-26T15:25:42.619 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2021-07-26T15:25:42.619 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:25:42.619 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2021-07-26T15:25:42.620 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:25:42.620 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:25:42.620 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:25:42.620 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:25:42.621 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2021-07-26T15:25:42.621 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:25:42.621 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2021-07-26T15:25:42.637 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-07-26T15:25:42.655 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-07-26T15:25:42.672 INFO:teuthology.task.internal:Checking for old test directory... 2021-07-26T15:25:42.673 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:25:42.675 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:25:42.681 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-07-26T15:25:42.699 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-07-26T15:25:42.699 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:25:42.722 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:25:42.738 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-07-26T15:25:42.785 INFO:teuthology.run_tasks:Running task kernel... 2021-07-26T15:25:42.808 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-07-26T15:25:42.809 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-07-26T15:25:42.810 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2021-07-26T15:25:42.817 INFO:teuthology.orchestra.run.smithi018.stdout:5.4.0-66-generic 2021-07-26T15:25:42.817 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.4.0-66-generic 2021-07-26T15:25:42.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2021-07-26T15:25:43.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2021-07-26T15:25:43.299 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:25:43.427 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:25:43.511 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:25:43.576 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:25:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:25:43.661 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:25:43.663 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:25:43.664 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [327 kB] 2021-07-26T15:25:43.668 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.5 kB] 2021-07-26T15:25:43.669 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.4 kB] 2021-07-26T15:25:43.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:25:43.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:25:43.686 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:25:43.690 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:25:43.691 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:25:43.700 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [25.4 kB] 2021-07-26T15:25:43.700 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,912 B] 2021-07-26T15:25:43.700 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,952 B] 2021-07-26T15:25:43.700 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:25:43.857 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:25:43.997 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:25:44.331 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:25:44.346 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:25:44.353 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:25:44.354 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [364 kB] 2021-07-26T15:25:44.365 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.8 kB] 2021-07-26T15:25:44.366 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.7 kB] 2021-07-26T15:25:44.367 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:25:44.367 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:25:44.435 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:25:44.455 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:25:44.457 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:25:44.458 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.4 kB] 2021-07-26T15:25:44.459 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,912 B] 2021-07-26T15:25:44.459 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,780 B] 2021-07-26T15:25:44.512 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:25:44.512 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:25:44.513 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:25:44.542 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:25:44.543 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:25:44.543 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:25:44.543 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:25:44.594 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:25:44.595 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:25:47.747 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 7,282 kB in 2s (4,726 kB/s) 2021-07-26T15:25:48.902 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:25:48.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:25:49.001 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:25:49.156 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2021-07-26T15:25:49.156 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2021-07-26T15:25:49.231 INFO:teuthology.orchestra.run.smithi018.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:25:49.233 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:25:49.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:25:49.304 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:25:49.451 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2021-07-26T15:25:49.451 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2021-07-26T15:25:49.581 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2021-07-26T15:25:49.581 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:25:49.581 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:25:49.582 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:25:49.582 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2021-07-26T15:25:49.582 INFO:teuthology.orchestra.run.smithi018.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:25:49.583 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2021-07-26T15:25:49.583 INFO:teuthology.orchestra.run.smithi018.stdout: thermald 2021-07-26T15:25:49.611 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2021-07-26T15:25:49.611 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:25:49.611 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:25:49.612 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:25:49.613 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2021-07-26T15:25:49.613 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:25:49.794 INFO:teuthology.orchestra.run.smithi018.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:25:49.795 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:25:49.795 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:25:49.795 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:25:50.933 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:25:51.142 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:25:52.513 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:25:52.514 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:25:52.514 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:25:52.803 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:25:52.841 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:25:53.278 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 75.6 MB in 3s (23.5 MB/s) 2021-07-26T15:25:53.444 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:25:54.879 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:25:54.885 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:55.140 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:57.229 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:25:57.236 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:57.335 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:58.454 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:25:58.469 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:03.634 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:26:03.775 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:26:04.110 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:26:04.236 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:26:04.579 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:26:04.596 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:26:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:26:11.662 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:26:11.685 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:26:11.753 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:15.043 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:26:15.173 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:26:15.491 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:16.739 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:26:16.905 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:18.175 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:26:18.176 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:18.323 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:18.449 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:19.634 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:26:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:26:19.911 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:26:20.038 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:26:20.285 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:26:20.285 INFO:teuthology.orchestra.run.smithi018.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:43.209 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:26:43.210 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:26:43.217 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:26:43.238 INFO:teuthology.orchestra.run.smithi018.stdout:Generating grub configuration file ... 2021-07-26T15:26:43.569 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:26:43.615 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:44.015 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:26:44.027 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:26:46.084 INFO:teuthology.orchestra.run.smithi018.stdout:done 2021-07-26T15:26:46.467 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2021-07-26T15:26:46.501 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2021-07-26T15:26:46.501 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2021-07-26T15:26:46.501 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2021-07-26T15:26:46.502 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2021-07-26T15:26:46.502 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 18 2021-07-26T15:26:46.502 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:26:46.502 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2021-07-26T15:26:46.503 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2021-07-26T15:26:46.503 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.4.0.80.84 2021-07-26T15:26:46.503 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:26:46.503 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:26:46.503 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2021-07-26T15:26:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2021-07-26T15:26:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:26:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2021-07-26T15:26:46.504 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:26:46.505 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2021-07-26T15:26:46.513 INFO:teuthology.orchestra.run.smithi111.stdout:5.4.0-66-generic 2021-07-26T15:26:46.513 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.4.0-66-generic 2021-07-26T15:26:46.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2021-07-26T15:26:46.610 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2021-07-26T15:26:46.769 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:26:46.908 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:26:47.002 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:26:47.048 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:26:47.127 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:26:47.132 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:26:47.134 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:26:47.135 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [327 kB] 2021-07-26T15:26:47.138 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.5 kB] 2021-07-26T15:26:47.138 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.4 kB] 2021-07-26T15:26:47.138 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:26:47.139 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:26:47.152 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:26:47.158 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:26:47.159 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:26:47.169 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [25.4 kB] 2021-07-26T15:26:47.171 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,912 B] 2021-07-26T15:26:47.171 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,952 B] 2021-07-26T15:26:47.172 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:26:47.383 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:26:47.512 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:26:47.845 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:26:47.863 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:26:47.868 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:26:47.868 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.8 kB] 2021-07-26T15:26:47.869 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [364 kB] 2021-07-26T15:26:47.879 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.7 kB] 2021-07-26T15:26:47.881 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:26:47.881 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:26:47.943 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:26:47.970 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:26:47.974 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:26:47.975 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,912 B] 2021-07-26T15:26:47.975 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.4 kB] 2021-07-26T15:26:47.976 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,780 B] 2021-07-26T15:26:48.030 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:26:48.031 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:26:48.031 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:26:48.032 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:26:48.113 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:26:48.114 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:26:48.114 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:26:48.115 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:26:48.115 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:26:51.023 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 7,282 kB in 2s (4,797 kB/s) 2021-07-26T15:26:52.081 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:26:52.101 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:26:52.165 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:26:52.323 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2021-07-26T15:26:52.324 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2021-07-26T15:26:52.402 INFO:teuthology.orchestra.run.smithi111.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:26:52.403 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:26:52.404 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:26:52.475 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:26:52.633 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2021-07-26T15:26:52.634 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2021-07-26T15:26:52.769 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2021-07-26T15:26:52.769 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:26:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:26:52.770 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:26:52.770 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2021-07-26T15:26:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:26:52.771 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2021-07-26T15:26:52.771 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2021-07-26T15:26:52.801 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2021-07-26T15:26:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:26:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:26:52.802 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:26:52.803 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2021-07-26T15:26:52.803 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:26:52.982 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:26:52.983 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:26:52.983 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:26:52.984 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:26:54.052 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:26:54.265 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:26:55.534 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:26:55.535 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:26:55.536 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:26:55.828 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:26:55.867 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:26:56.265 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 75.6 MB in 3s (24.7 MB/s) 2021-07-26T15:26:56.459 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:26:57.912 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:26:57.917 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:26:58.006 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:00.065 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:27:00.077 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:27:00.161 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:01.173 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:27:01.189 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:27:01.230 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:06.228 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:27:06.358 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:27:06.724 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:27:06.840 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:27:07.196 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:27:07.210 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:27:07.263 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:27:13.631 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:27:13.651 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:27:13.689 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:16.225 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:27:16.345 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:27:16.669 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:17.867 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:27:17.993 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:19.138 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:27:19.138 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:27:19.279 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:19.406 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:20.598 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:27:20.707 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:27:20.842 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:27:20.952 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:27:21.128 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:27:21.128 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:27:42.580 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:27:42.580 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:27:42.591 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:27:42.626 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2021-07-26T15:27:43.003 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:27:43.030 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:27:43.404 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:27:43.414 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:27:45.474 INFO:teuthology.orchestra.run.smithi111.stdout:done 2021-07-26T15:27:45.833 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2021-07-26T15:27:45.862 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2021-07-26T15:27:45.862 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2021-07-26T15:27:45.862 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2021-07-26T15:27:45.863 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2021-07-26T15:27:45.863 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 18 2021-07-26T15:27:45.863 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:27:45.863 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2021-07-26T15:27:45.864 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2021-07-26T15:27:45.864 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.4.0.80.84 2021-07-26T15:27:45.864 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:27:45.864 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:27:45.865 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2021-07-26T15:27:45.865 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2021-07-26T15:27:45.865 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:27:45.865 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2021-07-26T15:27:45.866 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:27:45.866 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-07-26T15:27:45.866 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:27:45.867 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:27:45.867 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-07-26T15:27:45.867 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:27:45.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2021-07-26T15:27:45.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2021-07-26T15:27:46.093 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:27:46.211 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:27:46.294 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:27:46.626 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:27:46.779 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:27:47.025 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:27:47.159 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [367 kB] 2021-07-26T15:27:47.181 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.2 kB] 2021-07-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.9 kB] 2021-07-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:27:47.229 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:27:47.261 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [7,472 B] 2021-07-26T15:27:47.261 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-07-26T15:27:47.262 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,472 B] 2021-07-26T15:27:47.675 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 3,796 kB in 1s (2,551 kB/s) 2021-07-26T15:27:48.466 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:27:48.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:27:48.554 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:27:48.719 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2021-07-26T15:27:48.720 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2021-07-26T15:27:48.803 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:27:48.804 INFO:teuthology.orchestra.run.smithi018.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:27:48.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:27:48.874 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:27:49.039 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2021-07-26T15:27:49.040 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2021-07-26T15:27:49.200 INFO:teuthology.orchestra.run.smithi018.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:27:49.200 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:27:49.202 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2021-07-26T15:27:49.223 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2021-07-26T15:27:49.224 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2021-07-26T15:27:49.224 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2021-07-26T15:27:49.224 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2021-07-26T15:27:49.224 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 18 2021-07-26T15:27:49.224 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:27:49.225 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2021-07-26T15:27:49.225 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2021-07-26T15:27:49.225 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.4.0.80.84 2021-07-26T15:27:49.225 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:27:49.226 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:27:49.226 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2021-07-26T15:27:49.226 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2021-07-26T15:27:49.226 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:27:49.226 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2021-07-26T15:27:49.227 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2021-07-26T15:27:49.274 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.jdfyxBRoqO 2021-07-26T15:27:49.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jdfyxBRoqO 2021-07-26T15:27:49.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.jdfyxBRoqO 2021-07-26T15:27:49.379 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.jdfyxBRoqO is 8KB 2021-07-26T15:27:49.402 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.jdfyxBRoqO 2021-07-26T15:27:49.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:27:49.466 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:27:49.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:27:49.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:27:49.510 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:27:49.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo update-grub 2021-07-26T15:27:50.983 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:27:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:27:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2021-07-26T15:27:51.283 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:27:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:27:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:27:51.668 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:27:52.751 INFO:teuthology.orchestra.run.smithi018.stderr:done 2021-07-26T15:27:52.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2021-07-26T15:27:52.756 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-07-26T15:27:52.756 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:27:52.756 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2021-07-26T15:27:52.823 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2021-07-26T15:27:52.969 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:27:53.085 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:27:53.168 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:27:53.504 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:27:53.648 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:27:53.982 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:27:53.999 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [367 kB] 2021-07-26T15:27:54.007 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.2 kB] 2021-07-26T15:27:54.008 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.9 kB] 2021-07-26T15:27:54.010 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:27:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:27:54.102 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-07-26T15:27:54.103 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [7,472 B] 2021-07-26T15:27:54.103 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,472 B] 2021-07-26T15:27:54.429 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 3,796 kB in 1s (2,690 kB/s) 2021-07-26T15:27:55.183 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:27:55.206 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:27:55.274 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:27:55.432 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2021-07-26T15:27:55.433 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2021-07-26T15:27:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:27:55.513 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:27:55.514 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:27:55.583 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:27:55.728 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2021-07-26T15:27:55.728 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2021-07-26T15:27:55.869 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:27:55.870 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:27:55.871 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2021-07-26T15:27:55.886 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2021-07-26T15:27:55.886 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2021-07-26T15:27:55.887 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2021-07-26T15:27:55.887 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2021-07-26T15:27:55.887 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 18 2021-07-26T15:27:55.887 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:27:55.887 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2021-07-26T15:27:55.888 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2021-07-26T15:27:55.888 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.4.0.80.84 2021-07-26T15:27:55.888 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:27:55.889 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:27:55.889 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2021-07-26T15:27:55.889 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2021-07-26T15:27:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:27:55.889 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2021-07-26T15:27:55.890 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2021-07-26T15:27:55.894 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.NQxdXykTx3 2021-07-26T15:27:55.895 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NQxdXykTx3 2021-07-26T15:27:55.961 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.NQxdXykTx3 2021-07-26T15:27:55.999 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.NQxdXykTx3 is 8KB 2021-07-26T15:27:56.012 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.NQxdXykTx3 2021-07-26T15:27:56.020 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:27:56.077 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:27:56.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:27:56.078 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:27:56.123 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:27:56.124 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2021-07-26T15:27:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:27:57.499 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:27:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2021-07-26T15:27:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:27:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:27:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:27:58.195 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:27:59.265 INFO:teuthology.orchestra.run.smithi111.stderr:done 2021-07-26T15:27:59.267 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2021-07-26T15:28:29.299 INFO:teuthology.misc:Re-opening connections... 2021-07-26T15:28:29.300 INFO:teuthology.misc:trying to connect to ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:28:29.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:29.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:29.363 DEBUG:teuthology.orchestra.remote:timed out 2021-07-26T15:29:29.365 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:29.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:29.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:32.431 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:32.432 DEBUG:teuthology.misc:waited 63.13177418708801 2021-07-26T15:29:33.433 INFO:teuthology.misc:trying to connect to ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:29:33.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:33.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:33.627 DEBUG:teuthology.orchestra.run.smithi018:> true 2021-07-26T15:29:34.215 DEBUG:teuthology.misc:waited 64.91474509239197 2021-07-26T15:29:35.216 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:35.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:35.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:35.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:35.499 DEBUG:teuthology.misc:waited 66.19936275482178 2021-07-26T15:29:36.500 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:36.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:36.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:39.566 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:39.567 DEBUG:teuthology.misc:waited 70.26734852790833 2021-07-26T15:29:40.568 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:40.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:40.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:42.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:42.635 DEBUG:teuthology.misc:waited 73.33531355857849 2021-07-26T15:29:43.636 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:43.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:43.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:45.707 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:45.707 DEBUG:teuthology.misc:waited 76.40737795829773 2021-07-26T15:29:46.708 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:46.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:46.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:48.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:48.784 DEBUG:teuthology.misc:waited 79.4838330745697 2021-07-26T15:29:49.784 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:49.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:49.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:51.851 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:51.851 DEBUG:teuthology.misc:waited 82.55138373374939 2021-07-26T15:29:52.852 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:52.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:52.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:54.923 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:54.923 DEBUG:teuthology.misc:waited 85.62353038787842 2021-07-26T15:29:55.926 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:55.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:55.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:57.995 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:29:57.996 DEBUG:teuthology.misc:waited 88.6961030960083 2021-07-26T15:29:58.997 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:29:58.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:29:58.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:30:01.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2021-07-26T15:30:01.071 DEBUG:teuthology.misc:waited 91.77138686180115 2021-07-26T15:30:02.072 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:30:02.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:30:02.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:30:33.855 DEBUG:teuthology.orchestra.remote:No existing session 2021-07-26T15:30:33.856 DEBUG:teuthology.misc:waited 124.55637264251709 2021-07-26T15:30:34.857 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:30:34.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:30:34.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:30:34.895 DEBUG:teuthology.orchestra.remote:No existing session 2021-07-26T15:30:34.896 DEBUG:teuthology.misc:waited 125.59624528884888 2021-07-26T15:30:35.897 INFO:teuthology.misc:trying to connect to ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:30:35.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:30:35.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:30:35.945 DEBUG:teuthology.orchestra.run.smithi111:> true 2021-07-26T15:30:36.694 DEBUG:teuthology.misc:waited 127.3937840461731 2021-07-26T15:30:37.695 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-07-26T15:30:37.696 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.4.0-80-generic"... 2021-07-26T15:30:37.696 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2021-07-26T15:30:37.705 INFO:teuthology.orchestra.run.smithi018.stdout:5.4.0-80-generic 2021-07-26T15:30:37.706 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:30:37.706 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:30:37.707 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:30:37.708 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-07-26T15:30:37.709 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.4.0-80-generic"... 2021-07-26T15:30:37.709 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2021-07-26T15:30:37.717 INFO:teuthology.orchestra.run.smithi111.stdout:5.4.0-80-generic 2021-07-26T15:30:37.717 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:30:37.718 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:30:37.718 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:30:38.719 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-07-26T15:30:38.719 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:30:38.802 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2021-07-26T15:30:38.831 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-07-26T15:30:38.832 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:30:38.897 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2021-07-26T15:30:38.923 INFO:teuthology.run_tasks:Running task internal.base... 2021-07-26T15:30:38.935 INFO:teuthology.task.internal:Creating test directory... 2021-07-26T15:30:38.936 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:30:38.939 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:30:38.946 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-07-26T15:30:39.065 INFO:teuthology.run_tasks:Running task internal.archive... 2021-07-26T15:30:39.204 INFO:teuthology.task.internal:Creating archive directory... 2021-07-26T15:30:39.205 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:30:39.208 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:30:39.241 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-07-26T15:30:39.360 INFO:teuthology.task.internal:Enabling coredump saving... 2021-07-26T15:30:39.362 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:30:39.365 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:30:39.389 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:30:39.398 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:30:39.400 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:30:39.409 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:30:39.411 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-07-26T15:30:39.456 INFO:teuthology.task.internal:Configuring sudo... 2021-07-26T15:30:39.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:30:39.459 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:30:39.475 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-07-26T15:30:39.568 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-07-26T15:30:39.569 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:30:39.572 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:30:39.579 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:30:39.628 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:30:39.635 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:30:39.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:30:39.656 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:30:39.664 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:30:39.711 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:30:39.712 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:30:39.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2021-07-26T15:30:39.748 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2021-07-26T15:30:39.841 INFO:teuthology.run_tasks:Running task internal.timer... 2021-07-26T15:30:39.852 INFO:teuthology.task.internal:Starting timer... 2021-07-26T15:30:39.852 INFO:teuthology.run_tasks:Running task pcp... 2021-07-26T15:30:40.033 INFO:teuthology.run_tasks:Running task selinux... 2021-07-26T15:30:40.157 DEBUG:teuthology.task.selinux:Excluding smithi018: OS 'ubuntu' does not support SELinux 2021-07-26T15:30:40.158 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2021-07-26T15:30:40.159 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-07-26T15:30:40.159 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-07-26T15:30:40.159 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-07-26T15:30:40.160 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-07-26T15:30:40.290 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-07-26T15:30:40.301 INFO:teuthology.repo_utils:Fetching master from origin 2021-07-26T15:30:40.335 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-07-26T15:30:40.360 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-07-26T15:30:40.362 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-07-26T15:30:40.768 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-07-26T15:30:41.610 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-07-26T15:30:44.549 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-07-26T15:30:44.577 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:44 +0000 (0:00:00.041) 0:00:00.041 *********** 2021-07-26T15:30:44.585 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:44 +0000 (0:00:00.012) 0:00:00.053 *********** 2021-07-26T15:30:46.841 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:30:46.843 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi111.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi111.front.sepia.ceph.com] 2021-07-26T15:30:46.853 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi018.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi018.front.sepia.ceph.com] 2021-07-26T15:30:46.914 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:46 +0000 (0:00:02.329) 0:00:02.382 *********** 2021-07-26T15:30:47.050 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.136) 0:00:02.518 *********** 2021-07-26T15:30:47.288 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-07-26T15:30:47.289 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:30:47.311 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.260) 0:00:02.779 *********** 2021-07-26T15:30:47.332 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.021) 0:00:02.801 *********** 2021-07-26T15:30:47.865 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-07-26T15:30:47.866 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} changed: [smithi111.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:30:47.898 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.564) 0:00:03.365 *********** 2021-07-26T15:30:47.920 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.023) 0:00:03.389 *********** 2021-07-26T15:30:48.264 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.065261", "end": "2021-07-26 15:30:48.476135", "rc": 0, "start": "2021-07-26 15:30:48.410874", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:30:48.286 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.366) 0:00:03.755 *********** 2021-07-26T15:30:48.294 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.087154", "end": "2021-07-26 15:30:48.616631", "rc": 0, "start": "2021-07-26 15:30:48.529477", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:30:48.319 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.032) 0:00:03.787 *********** 2021-07-26T15:30:48.548 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-07-26T15:30:48.550 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:30:48.574 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.255) 0:00:04.042 *********** 2021-07-26T15:30:48.582 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:30:48.608 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.034) 0:00:04.076 *********** 2021-07-26T15:30:49.504 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-07-26T15:30:49.506 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313448.647307-18293-209766420575880/source", "state": "file", "uid": 0} 2021-07-26T15:30:49.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.918) 0:00:04.995 *********** 2021-07-26T15:30:49.534 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313448.6110995-18277-198044186244641/source", "state": "file", "uid": 0} 2021-07-26T15:30:49.560 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.033) 0:00:05.029 *********** 2021-07-26T15:30:49.953 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-07-26T15:30:49.955 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-07-26T15:30:49.957 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-07-26T15:30:49.977 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-07-26T15:30:49.979 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-07-26T15:30:50.055 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2021-07-26T15:30:50.057 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY [testnodes] *************************************************************** 2021-07-26T15:30:50.069 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Monday 26 July 2021 15:30:50 +0000 (0:00:00.509) 0:00:05.538 *********** 2021-07-26T15:30:50.790 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] 2021-07-26T15:30:50.820 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] 2021-07-26T15:30:50.840 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-07-26T15:30:50.842 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.770) 0:00:06.308 *********** 2021-07-26T15:30:50.894 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:30:50.907 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:30:50.924 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:30:51.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.235) 0:00:06.544 *********** 2021-07-26T15:30:51.096 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.020) 0:00:06.565 *********** 2021-07-26T15:30:51.924 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi018.front.sepia.ceph.com] 2021-07-26T15:30:51.979 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-07-26T15:30:51.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.882) 0:00:07.448 *********** 2021-07-26T15:30:52.034 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] 2021-07-26T15:30:52.092 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.112) 0:00:07.560 *********** 2021-07-26T15:30:52.434 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.205671", "end": "2021-07-26 15:30:52.398845", "rc": 0, "start": "2021-07-26 15:30:52.193174", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:30:52.458 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.366) 0:00:07.926 *********** 2021-07-26T15:30:52.520 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.172680", "end": "2021-07-26 15:30:52.488891", "rc": 0, "start": "2021-07-26 15:30:52.316211", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:30:52.545 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.087) 0:00:08.014 *********** 2021-07-26T15:30:52.604 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010098", "end": "2021-07-26 15:30:52.814494", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:30:52.804396", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:30:52.630 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.084) 0:00:08.098 *********** 2021-07-26T15:30:52.690 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015210", "end": "2021-07-26 15:30:53.024053", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:30:53.008843", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:30:52.718 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.086) 0:00:08.185 *********** 2021-07-26T15:30:52.725 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:52.728 INFO:teuthology.task.ansible.out:TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.754 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.037) 0:00:08.222 *********** 2021-07-26T15:30:52.793 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.817 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.062) 0:00:08.285 *********** 2021-07-26T15:30:52.823 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-07-26T15:30:52.825 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.850 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.033) 0:00:08.318 *********** 2021-07-26T15:30:52.878 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.903 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.052) 0:00:08.371 *********** 2021-07-26T15:30:52.920 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.946 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.042) 0:00:08.413 *********** 2021-07-26T15:30:52.973 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.998 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.052) 0:00:08.466 *********** 2021-07-26T15:30:53.015 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-07-26T15:30:53.016 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.041) 0:00:08.507 *********** 2021-07-26T15:30:53.067 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.091 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.051) 0:00:08.559 *********** 2021-07-26T15:30:53.118 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.142 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.050) 0:00:08.610 *********** 2021-07-26T15:30:53.169 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.193 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.051) 0:00:08.662 *********** 2021-07-26T15:30:53.324 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-07-26T15:30:53.326 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:30:53.349 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.155) 0:00:08.817 *********** 2021-07-26T15:30:53.387 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:30:53.417 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.068) 0:00:08.885 *********** 2021-07-26T15:30:53.644 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:30:53.669 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:30:53.799 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:30:53.810 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:30:53.949 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:30:53.951 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:30:54.099 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:30:54.102 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:30:54.242 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:30:54.261 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:30:54.388 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:30:54.401 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:30:54.529 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:30:54.542 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:30:54.672 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:30:54.695 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:30:54.814 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:30:54.848 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:30:54.975 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:30:54.987 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:30:55.122 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:30:55.134 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:30:55.270 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:30:55.272 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:30:55.407 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:30:55.420 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:30:55.555 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:30:55.556 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:30:55.692 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:30:55.704 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:30:55.841 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:30:55.852 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:30:55.988 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:30:56.002 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:30:56.139 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:30:56.140 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:30:56.276 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:30:56.288 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:30:56.424 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:30:56.435 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:30:56.572 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:30:56.573 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:30:56.719 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:30:56.720 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:30:56.856 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:30:56.867 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:30:57.003 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:30:57.005 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:30:57.140 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:30:57.152 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:30:57.288 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:30:57.299 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:30:57.426 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:30:57.438 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:30:57.576 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:30:57.587 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:30:57.725 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:30:57.725 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:30:57.863 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:30:57.874 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:30:58.032 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:30:58.044 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:30:58.181 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:30:58.182 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:30:58.332 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:30:58.344 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:30:58.472 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:30:58.484 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:30:58.634 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:30:58.639 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:30:58.769 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:30:58.781 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:30:58.924 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:30:58.926 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:30:59.063 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:30:59.075 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:30:59.201 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:30:59.213 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:30:59.354 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:30:59.365 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:30:59.503 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:30:59.516 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:30:59.655 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:30:59.666 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:30:59.802 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:30:59.813 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:30:59.960 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:30:59.962 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:31:00.120 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:31:00.260 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:31:00.394 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:31:00.406 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:31:00.544 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:31:00.546 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:31:00.700 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:31:00.702 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:31:00.850 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:31:00.852 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:31:00.990 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:31:00.992 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:31:01.149 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:31:01.150 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:31:01.287 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:31:01.299 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:31:01.425 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:31:01.437 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:31:01.579 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:31:01.581 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:31:01.719 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:31:01.730 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:31:01.868 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:31:01.869 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:31:02.009 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:31:02.145 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:31:02.157 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:31:02.295 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:31:02.306 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:31:02.432 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:31:02.443 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:31:02.569 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:31:02.593 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:31:02.717 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:31:02.738 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:31:02.864 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:31:02.885 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:31:03.000 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:31:03.032 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:31:03.147 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:31:03.169 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:31:03.283 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:31:03.316 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:31:03.431 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:31:03.465 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:31:03.580 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:31:03.612 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:31:03.717 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:31:03.749 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:31:03.863 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:31:03.896 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:31:04.000 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:31:04.043 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:31:04.147 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:31:04.190 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:31:04.283 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:31:04.326 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:31:04.430 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:31:04.472 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:31:04.567 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:31:04.620 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:31:04.714 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:31:04.756 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:31:04.861 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:31:04.904 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:31:05.008 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:31:05.050 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:31:05.145 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:31:05.187 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:31:05.291 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:31:05.333 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:31:05.438 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:31:05.481 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:31:05.575 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:31:05.628 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:31:05.722 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:31:05.775 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:31:05.869 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:31:05.913 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:31:06.007 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:31:06.060 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:31:06.154 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:31:06.207 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:31:06.301 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:31:06.354 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:31:06.438 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:31:06.490 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:31:06.574 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:31:06.637 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:31:06.721 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:31:06.784 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:31:06.857 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:31:06.931 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:31:07.005 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:31:07.078 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:31:07.141 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:31:07.225 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:31:07.288 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:31:07.361 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:31:07.435 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:31:07.508 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:31:07.571 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:31:07.654 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:31:07.719 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:31:07.792 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:31:07.866 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:31:07.940 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:31:08.004 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:31:08.089 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:31:08.152 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:31:08.236 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:31:08.288 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:31:08.382 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:31:08.435 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:31:08.530 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:31:08.583 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:31:08.667 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:31:08.731 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:31:08.815 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:31:08.868 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:31:08.962 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:31:09.015 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:31:09.109 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:31:09.152 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:31:09.247 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:31:09.299 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:31:09.394 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:31:09.436 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:31:09.531 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:31:09.583 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:31:09.679 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:31:09.722 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:31:09.824 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:31:09.867 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:31:09.972 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:31:10.004 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:31:10.120 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:31:10.152 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:31:10.266 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:31:10.288 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:31:10.413 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:31:10.434 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:31:10.559 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:31:10.570 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:31:10.696 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:31:10.718 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:31:10.842 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:31:10.854 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:31:10.989 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:31:11.000 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:31:11.135 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:31:11.136 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:31:11.282 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:31:11.284 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:31:11.419 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:31:11.430 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:31:11.566 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:31:11.577 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:31:11.702 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:31:11.724 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:31:11.849 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:31:11.860 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:31:11.985 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:31:12.007 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:31:12.132 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:31:12.144 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:31:12.278 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:31:12.290 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:31:12.414 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:31:12.436 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:31:12.560 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:31:12.582 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:31:12.708 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:31:12.719 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:31:12.844 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:31:12.865 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:31:12.990 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:31:13.012 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:31:13.136 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:31:13.147 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:31:13.272 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:31:13.294 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:31:13.419 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:31:13.440 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:31:13.585 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:31:13.875 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:31:14.196 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:31:14.393 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:31:14.694 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:31:14.871 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:31:15.202 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:31:15.410 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:31:15.730 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:31:15.917 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:31:16.347 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:31:16.370 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:31:16.857 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:31:16.900 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:31:17.385 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:31:17.427 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:31:17.882 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:31:17.976 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:31:18.349 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:31:18.495 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:31:18.788 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:31:18.975 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:31:19.318 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:31:19.525 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:31:19.787 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:31:20.053 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:31:20.313 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:31:20.553 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:31:20.800 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:31:20.952 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:20 +0000 (0:00:27.535) 0:00:36.420 *********** 2021-07-26T15:31:21.012 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:31:21.023 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-07-26T15:31:21.047 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:21 +0000 (0:00:00.094) 0:00:36.515 *********** 2021-07-26T15:31:21.137 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:31:21.139 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:31:21.141 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:31:21.143 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:31:21.144 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:31:21.146 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:31:21.148 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:31:21.150 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:31:21.151 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:31:21.153 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:31:21.155 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:31:21.156 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:31:21.158 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:31:21.159 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:31:21.161 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor- 2021-07-26T15:31:21.161 INFO:teuthology.task.ansible.out:mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:31:21.190 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:21 +0000 (0:00:00.143) 0:00:36.658 *********** 2021-07-26T15:31:21.469 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:31:21.622 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:21 +0000 (0:00:00.432) 0:00:37.091 *********** 2021-07-26T15:31:21.691 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-07-26T15:31:21.714 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:21 +0000 (0:00:00.092) 0:00:37.183 *********** 2021-07-26T15:31:21.810 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:31:21.813 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:31:21.815 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:31:21.816 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:31:21.818 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:31:21.820 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:31:21.821 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:31:21.823 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn" 2021-07-26T15:31:21.824 INFO:teuthology.task.ansible.out:: "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:31:21.825 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:31:21.827 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:31:21.829 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:31:21.831 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e104 2021-07-26T15:31:21.831 INFO:teuthology.task.ansible.out:6655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:31:21.833 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:31:21.834 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:31:21.836 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:31:21.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:21 +0000 (0:00:00.145) 0:00:37.328 *********** 2021-07-26T15:31:22.395 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-07-26T15:31:22.397 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:31:22.419 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:22 +0000 (0:00:00.559) 0:00:37.888 *********** 2021-07-26T15:31:22.663 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:31:22.665 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:31:22.717 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-07-26T15:31:22.718 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:31:22.747 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:22 +0000 (0:00:00.327) 0:00:38.216 *********** 2021-07-26T15:31:22.809 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:31:22.810 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:31:22.935 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:31:22.998 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:31:23.071 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:31:23.072 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:31:23.133 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:31:23.196 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:31:23.269 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:31:23.321 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:31:23.323 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:31:23.394 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:31:23.396 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:31:23.457 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:31:23.530 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:31:23.592 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:31:23.655 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:31:23.657 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:31:23.729 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:31:23.730 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:23.793 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:31:23.856 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:31:23.857 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:31:23.928 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:31:24.012 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:31:24.014 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:24.023 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:24.055 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:31:24.066 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:24.149 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:31:24.191 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:31:24.193 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:31:24.275 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:31:24.277 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:31:24.339 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:31:24.340 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-07-26T15:31:24.350 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:24.351 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:24.405 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:31:24.478 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:31:24.561 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:31:24.563 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:31:24.614 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:31:24.616 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:31:24.687 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:31:24.755 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:31:24.828 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:31:24.901 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:31:24.903 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:31:24.954 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:31:25.038 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:31:25.081 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:31:25.083 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:31:25.164 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:31:25.217 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:31:25.219 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:31:25.301 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:31:25.353 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:31:25.436 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:31:25.438 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:31:25.478 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:31:25.562 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:31:25.564 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:31:25.605 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:31:25.606 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:31:25.709 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:31:25.741 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:31:25.846 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:31:25.867 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:31:25.982 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:31:25.984 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:31:26.003 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:31:26.107 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:31:26.129 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:31:26.277 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:31:26.393 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:31:26.528 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:31:26.560 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:31:26.561 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:31:26.654 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:31:26.686 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:31:26.791 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:31:26.833 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:31:26.926 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:31:26.928 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:31:26.959 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:31:27.053 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:31:27.095 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:31:27.189 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:31:27.221 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:31:27.315 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:31:27.358 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:31:27.452 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:31:27.484 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:31:27.587 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:31:27.619 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:31:27.723 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:31:27.745 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:31:27.747 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:31:27.849 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:31:27.891 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:31:27.893 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:31:27.975 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:31:28.017 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:31:28.111 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:31:28.113 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:31:28.143 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:31:28.247 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:31:28.249 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:31:28.279 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:31:28.372 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:31:28.414 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:31:28.417 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:31:28.508 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:31:28.550 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:31:28.552 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:31:28.554 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:31:28.634 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:31:28.676 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:31:28.770 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:31:28.772 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:31:28.812 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:31:28.906 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:31:28.908 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:31:28.910 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:31:28.938 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:31:29.042 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:31:29.074 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:31:29.178 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:31:29.199 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:31:29.314 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:31:29.335 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:31:29.337 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:31:29.439 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:31:29.471 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:31:29.575 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:31:29.607 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:31:29.712 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:31:29.713 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:31:29.733 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:31:29.734 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:31:29.841 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:31:29.863 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:31:29.968 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:31:30.000 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:31:30.104 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:31:30.106 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:31:30.126 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:31:30.127 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:31:30.230 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:31:30.262 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:31:30.367 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:31:30.388 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:31:30.503 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:31:30.505 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:31:30.515 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:31:30.630 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:31:30.641 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:31:30.766 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:31:30.778 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:31:30.892 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:31:30.914 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:31:31.029 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:31:31.040 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:31:31.167 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIIT 2021-07-26T15:31:31.169 INFO:teuthology.task.ansible.out:kwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:31:31.292 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:31:31.294 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:31:31.418 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:31:31.429 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:31:31.554 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:31:31.556 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:31:31.681 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:31:31.683 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:31:31.809 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:31:31.831 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:31:31.946 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:31:31.958 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:31:32.082 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:31:32.094 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:31:32.218 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:31:32.219 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:31:32.344 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:31:32.356 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:31:32.481 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:31:32.492 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:31:32.617 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:31:32.639 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:31:32.765 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:31:32.765 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:31:32.901 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:31:32.902 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:31:32.912 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:31:33.026 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:31:33.048 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:31:33.152 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:31:33.174 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:31:33.289 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:31:33.301 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:31:33.302 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:31:33.416 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:31:33.437 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:31:33.552 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:31:33.554 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:31:33.563 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:31:33.678 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:31:33.680 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:31:33.700 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:31:33.815 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:31:33.837 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:31:33.942 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:31:33.963 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:31:33.965 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:31:34.067 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:31:34.099 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:31:34.101 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:31:34.205 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:31:34.237 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:31:34.331 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:31:34.363 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:31:34.457 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:31:34.499 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:31:34.594 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:31:34.626 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:31:34.719 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:31:34.722 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:31:34.762 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:31:34.764 INFO:teuthology.task.ansible.out: 2021-07-26T15:31:34.859 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:31:34.901 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:31:34.986 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:31:35.029 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:31:35.122 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:31:35.164 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:31:35.166 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:31:35.258 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:31:35.290 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:31:35.384 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:31:35.426 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:31:35.520 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:31:35.552 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:31:35.646 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:31:35.648 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:31:35.688 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:31:35.772 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:31:35.814 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:31:35.908 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:31:35.950 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:31:36.044 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:31:36.077 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:31:36.079 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:31:36.171 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:31:36.213 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:31:36.307 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:31:36.349 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:31:36.444 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:31:36.506 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:31:36.579 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:31:36.642 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:31:36.704 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:31:36.767 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:31:36.840 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:31:36.902 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:31:36.965 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:31:37.038 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:31:37.111 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:31:37.174 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:31:37.249 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:31:37.301 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:31:37.374 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:31:37.437 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:31:37.501 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:31:37.564 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:31:37.637 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:31:37.699 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:31:37.772 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:31:37.837 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:31:37.920 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:31:37.962 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:31:38.056 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:31:38.098 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:31:38.182 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:31:38.184 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:31:38.224 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:31:38.318 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:31:38.361 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:31:38.444 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:31:38.486 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:31:38.569 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:31:38.622 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:31:38.623 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:31:38.715 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:31:38.769 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:31:38.845 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:31:38.899 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:31:38.985 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:31:39.049 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:31:39.114 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:31:39.187 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:31:39.240 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:31:39.324 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:31:39.366 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:31:39.470 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:31:39.502 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:31:39.606 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:31:39.648 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:31:39.742 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:31:39.774 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:31:39.884 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:31:39.906 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:31:40.020 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:31:40.042 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:31:40.152 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:31:40.173 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:31:40.287 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:31:40.309 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:31:40.423 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:31:40.445 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:31:40.446 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:31:40.549 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:31:40.581 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:31:40.685 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:31:40.717 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:31:40.821 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:31:40.853 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:31:40.947 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:31:40.949 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:31:40.989 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:31:41.083 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:31:41.115 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:31:41.219 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:31:41.251 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:31:41.345 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:31:41.377 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:31:41.481 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:31:41.502 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:31:41.616 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:31:41.627 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:31:41.742 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:31:41.763 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:31:41.878 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:31:41.899 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:31:42.005 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:31:42.035 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:31:42.138 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:31:42.170 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:31:42.275 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:31:42.300 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:31:42.406 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:31:42.427 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:31:42.563 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "ma 2021-07-26T15:31:42.565 INFO:teuthology.task.ansible.out:nage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:31:42.748 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:31:42.771 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:42 +0000 (0:00:20.023) 0:00:58.239 *********** 2021-07-26T15:31:42.824 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:31:42.856 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:31:42.858 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.867 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.878 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.880 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.889 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.900 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.902 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.911 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.922 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:42.954 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:31:42.956 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:31:43.069 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:31:43.071 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-07-26T15:31:43.073 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.081 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.092 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:31:43.093 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:31:43.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:43 +0000 (0:00:00.407) 0:00:58.647 *********** 2021-07-26T15:31:43.217 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-07-26T15:31:43.260 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.270 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.272 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.282 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.283 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.293 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.304 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.306 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.315 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.338 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-07-26T15:31:43.349 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.360 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.371 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.372 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.383 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.393 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.395 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.405 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.406 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.416 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.417 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.428 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.439 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.440 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.450 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.452 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vE 2021-07-26T15:31:43.453 INFO:teuthology.task.ansible.out:k7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-07-26T15:31:43.462 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.464 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.474 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.475 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.486 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.487 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.497 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.499 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.508 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.510 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.520 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.521 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.531 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.542 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.544 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.554 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.555 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.565 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.567 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.576 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.577 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.588 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.599 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.601 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1 2021-07-26T15:31:43.603 INFO:teuthology.task.ansible.out:PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-07-26T15:31:43.611 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.613 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.623 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.625 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.634 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.645 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.646 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.656 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.658 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.667 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.669 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.679 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.680 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.690 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.701 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.702 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.712 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.714 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.723 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.725 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.735 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.735 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-07-26T15:31:43.737 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.747 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.748 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": 2021-07-26T15:31:43.750 INFO:teuthology.task.ansible.out:"oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.759 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.761 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9faf 2021-07-26T15:31:43.763 INFO:teuthology.task.ansible.out:cfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.771 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.773 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.783 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.785 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.795 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.796 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.796 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.807 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.809 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.809 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (it 2021-07-26T15:31:43.811 INFO:teuthology.task.ansible.out:em={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.820 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.822 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.832 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.834 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.836 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.845 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.846 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.857 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.858 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.858 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.860 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.870 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.871 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.871 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.883 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.885 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.895 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.908 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.910 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.920 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.922 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.932 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.933 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.944 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.946 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.956 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.958 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.968 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.969 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.969 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.980 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.982 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.992 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:43.994 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.004 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.006 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.016 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.017 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.027 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.029 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.039 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.041 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.051 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.053 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.053 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.064 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.066 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.076 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.078 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.088 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.090 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.100 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.102 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.113 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.115 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.125 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.127 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.138 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.139 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.150 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.151 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.162 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.164 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.174 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.176 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.187 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.188 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.199 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.201 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.211 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.214 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.223 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.225 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.243 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.245 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.269 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:44 +0000 (0:00:01.090) 0:00:59.737 *********** 2021-07-26T15:31:44.276 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.278 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.290 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.292 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.302 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.313 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.316 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.324 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.326 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.336 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.337 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.347 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.349 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.372 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:44 +0000 (0:00:00.103) 0:00:59.840 *********** 2021-07-26T15:31:44.380 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.382 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.393 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.397 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.404 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.406 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.416 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.418 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.427 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.438 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.440 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.449 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.460 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.462 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.472 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.473 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.483 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.485 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.494 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.496 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.506 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.517 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.519 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.528 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.530 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.539 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.541 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.551 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.561 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.563 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.573 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.574 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.584 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.586 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.595 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.597 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.607 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:31:44.609 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.619 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.620 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.631 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.632 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.643 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.644 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.654 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.696 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:44 +0000 (0:00:00.324) 0:01:00.165 *********** 2021-07-26T15:31:44.735 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:31:44.737 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:31:44.758 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-07-26T15:31:44.760 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:44 +0000 (0:00:00.085) 0:01:00.250 *********** 2021-07-26T15:31:44.871 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi111.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:31:44.996 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:31:45.007 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:31:45.133 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:31:45.144 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:31:45.269 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:31:45.280 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:31:45.405 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:31:45.416 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:31:45.532 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:31:45.543 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:31:45.668 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:31:45.679 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:31:45.805 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:31:45.817 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:31:45.942 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:31:45.953 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:31:46.078 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:31:46.090 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:31:46.225 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:31:46.227 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:31:46.361 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:31:46.363 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:31:46.486 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:31:46.497 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:31:46.623 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:31:46.634 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:31:46.760 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:31:46.761 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:31:46.896 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:31:46.897 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:31:47.022 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:31:47.033 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:31:47.158 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:31:47.159 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:31:47.294 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:31:47.295 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:31:47.431 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:31:47.433 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:31:47.558 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:31:47.569 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:31:47.695 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:31:47.707 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:31:47.833 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} ok: [smithi018.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:31:47.969 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:31:47.980 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:31:48.105 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:31:48.116 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:31:48.241 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:31:48.241 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:31:48.366 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:31:48.388 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:31:48.502 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:31:48.524 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:31:48.638 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:31:48.650 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:31:48.765 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:31:48.786 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:31:48.901 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:31:48.912 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:31:49.026 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:31:49.047 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:31:49.162 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:31:49.183 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:31:49.287 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:31:49.309 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:31:49.424 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:31:49.446 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:31:49.570 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:31:49.571 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:31:49.707 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:31:49.842 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:31:49.977 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:31:50.030 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:31:50.165 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:31:50.299 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:31:50.426 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:31:50.458 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:31:50.562 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:31:50.604 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:31:50.698 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:31:50.741 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:31:50.824 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:31:50.866 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:31:50.971 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:31:51.003 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:31:51.107 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:31:51.139 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:31:51.233 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:31:51.275 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:31:51.369 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:31:51.414 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:51 +0000 (0:00:06.632) 0:01:06.882 *********** 2021-07-26T15:31:51.422 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:31:51.539 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:31:51.674 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:31:51.800 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:31:51.832 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:31:51.834 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313511.5006616-21866-147629530979097/source", "state": "file", "uid": 0} 2021-07-26T15:31:51.856 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:51 +0000 (0:00:00.441) 0:01:07.324 *********** 2021-07-26T15:31:51.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:51 +0000 (0:00:00.021) 0:01:07.346 *********** 2021-07-26T15:31:51.958 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-07-26T15:31:51.960 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => { "msg": "Host smithi111.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:31:51.983 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:51 +0000 (0:00:00.105) 0:01:07.451 *********** 2021-07-26T15:31:52.061 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-07-26T15:31:52.063 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:31:52.086 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.103) 0:01:07.554 *********** 2021-07-26T15:31:52.154 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-07-26T15:31:52.156 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.091) 0:01:07.646 *********** 2021-07-26T15:31:52.246 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-07-26T15:31:52.248 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.270 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.092) 0:01:07.738 *********** 2021-07-26T15:31:52.276 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:31:52.278 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313511.936687-21918-9369268388844/source", "state": "file", "uid": 0} 2021-07-26T15:31:52.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.032) 0:01:07.771 *********** 2021-07-26T15:31:52.341 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.366 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.062) 0:01:07.834 *********** 2021-07-26T15:31:52.383 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-07-26T15:31:52.385 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => { "msg": "Host smithi018.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:31:52.408 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.042) 0:01:07.876 *********** 2021-07-26T15:31:52.436 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.461 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.053) 0:01:07.930 *********** 2021-07-26T15:31:52.488 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-07-26T15:31:52.490 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:31:52.513 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.052) 0:01:07.982 *********** 2021-07-26T15:31:52.531 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-07-26T15:31:52.533 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.556 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.042) 0:01:08.024 *********** 2021-07-26T15:31:52.583 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-07-26T15:31:52.585 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.612 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.056) 0:01:08.080 *********** 2021-07-26T15:31:52.630 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-07-26T15:31:52.632 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.656 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.044) 0:01:08.125 *********** 2021-07-26T15:31:52.684 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-07-26T15:31:52.685 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.708 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.052) 0:01:08.177 *********** 2021-07-26T15:31:52.736 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-07-26T15:31:52.738 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.761 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.052) 0:01:08.229 *********** 2021-07-26T15:31:52.809 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-07-26T15:31:52.811 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.833 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.071) 0:01:08.301 *********** 2021-07-26T15:31:52.839 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-07-26T15:31:52.842 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.865 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.031) 0:01:08.333 *********** 2021-07-26T15:31:52.902 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-07-26T15:31:52.904 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:52.927 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.062) 0:01:08.396 *********** 2021-07-26T15:31:52.944 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-07-26T15:31:52.946 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:52.970 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:52 +0000 (0:00:00.042) 0:01:08.438 *********** 2021-07-26T15:31:53.001 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-07-26T15:31:53.003 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.029 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.058) 0:01:08.497 *********** 2021-07-26T15:31:53.046 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:31:53.048 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.073 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.043) 0:01:08.541 *********** 2021-07-26T15:31:53.110 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-07-26T15:31:53.112 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.134 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.061) 0:01:08.603 *********** 2021-07-26T15:31:53.152 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-07-26T15:31:53.153 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.177 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.042) 0:01:08.645 *********** 2021-07-26T15:31:53.215 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-07-26T15:31:53.217 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.243 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.065) 0:01:08.711 *********** 2021-07-26T15:31:53.250 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-07-26T15:31:53.252 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.276 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.033) 0:01:08.745 *********** 2021-07-26T15:31:53.314 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-07-26T15:31:53.316 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.339 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.062) 0:01:08.807 *********** 2021-07-26T15:31:53.344 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:31:53.346 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:53.371 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.032) 0:01:08.839 *********** 2021-07-26T15:31:53.419 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-07-26T15:31:53.421 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:53.444 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.073) 0:01:08.913 *********** 2021-07-26T15:31:53.451 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-07-26T15:31:53.452 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.477 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.032) 0:01:08.945 *********** 2021-07-26T15:31:53.514 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:31:53.516 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.542 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.065) 0:01:09.011 *********** 2021-07-26T15:31:53.550 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-07-26T15:31:53.552 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:53.577 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.034) 0:01:09.046 *********** 2021-07-26T15:31:53.615 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-07-26T15:31:53.616 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.639 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.061) 0:01:09.107 *********** 2021-07-26T15:31:53.656 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:31:53.658 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.694 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.054) 0:01:09.162 *********** 2021-07-26T15:31:53.724 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-07-26T15:31:53.725 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.753 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.058) 0:01:09.221 *********** 2021-07-26T15:31:53.770 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:31:53.771 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.795 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.042) 0:01:09.263 *********** 2021-07-26T15:31:53.822 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:31:53.824 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:53.853 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.058) 0:01:09.321 *********** 2021-07-26T15:31:53.871 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-07-26T15:31:53.873 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.906 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.053) 0:01:09.375 *********** 2021-07-26T15:31:53.936 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-07-26T15:31:53.938 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:53.962 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:53 +0000 (0:00:00.056) 0:01:09.431 *********** 2021-07-26T15:31:53.981 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.007 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.044) 0:01:09.475 *********** 2021-07-26T15:31:54.025 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-07-26T15:31:54.027 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:54.051 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.043) 0:01:09.519 *********** 2021-07-26T15:31:54.089 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-07-26T15:31:54.091 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:54.115 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.063) 0:01:09.583 *********** 2021-07-26T15:31:54.124 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:31:54.125 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.164 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.049) 0:01:09.632 *********** 2021-07-26T15:31:54.182 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.212 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.048) 0:01:09.681 *********** 2021-07-26T15:31:54.239 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:31:54.241 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.264 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.051) 0:01:09.732 *********** 2021-07-26T15:31:54.281 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-07-26T15:31:54.282 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.306 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.041) 0:01:09.774 *********** 2021-07-26T15:31:54.333 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.358 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.052) 0:01:09.826 *********** 2021-07-26T15:31:54.388 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-07-26T15:31:54.389 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.424 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.066) 0:01:09.893 *********** 2021-07-26T15:31:54.444 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.472 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.047) 0:01:09.940 *********** 2021-07-26T15:31:54.500 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-07-26T15:31:54.502 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.055) 0:01:09.995 *********** 2021-07-26T15:31:54.546 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-07-26T15:31:54.548 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:54.573 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.046) 0:01:10.042 *********** 2021-07-26T15:31:54.592 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-07-26T15:31:54.594 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.619 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.045) 0:01:10.087 *********** 2021-07-26T15:31:54.636 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:31:54.638 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.662 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.043) 0:01:10.130 *********** 2021-07-26T15:31:54.682 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.714 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.051) 0:01:10.182 *********** 2021-07-26T15:31:54.731 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-07-26T15:31:54.733 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.758 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.044) 0:01:10.226 *********** 2021-07-26T15:31:54.787 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-07-26T15:31:54.789 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:54.812 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.053) 0:01:10.280 *********** 2021-07-26T15:31:54.830 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-07-26T15:31:54.831 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.856 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.044) 0:01:10.325 *********** 2021-07-26T15:31:54.884 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-07-26T15:31:54.886 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.908 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.052) 0:01:10.377 *********** 2021-07-26T15:31:54.925 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-07-26T15:31:54.927 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:54.950 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:54 +0000 (0:00:00.041) 0:01:10.418 *********** 2021-07-26T15:31:54.977 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-07-26T15:31:54.979 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.004 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.053) 0:01:10.472 *********** 2021-07-26T15:31:55.021 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-07-26T15:31:55.022 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.049 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.045) 0:01:10.517 *********** 2021-07-26T15:31:55.077 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-07-26T15:31:55.079 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.102 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.052) 0:01:10.570 *********** 2021-07-26T15:31:55.119 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-07-26T15:31:55.121 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.144 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.042) 0:01:10.613 *********** 2021-07-26T15:31:55.182 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-07-26T15:31:55.184 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.208 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.064) 0:01:10.677 *********** 2021-07-26T15:31:55.214 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-07-26T15:31:55.216 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:31:55.240 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.031) 0:01:10.709 *********** 2021-07-26T15:31:55.278 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-07-26T15:31:55.280 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.304 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.063) 0:01:10.772 *********** 2021-07-26T15:31:55.311 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-07-26T15:31:55.312 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.337 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.032) 0:01:10.805 *********** 2021-07-26T15:31:55.374 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:31:55.376 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.399 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.061) 0:01:10.867 *********** 2021-07-26T15:31:55.416 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-07-26T15:31:55.417 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.440 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.041) 0:01:10.909 *********** 2021-07-26T15:31:55.509 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.532 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.092) 0:01:11.001 *********** 2021-07-26T15:31:55.592 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:31:55.593 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013933", "end": "2021-07-26 15:31:55.926806", "rc": 0, "start": "2021-07-26 15:31:55.912873", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:31:55.616 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.083) 0:01:11.085 *********** 2021-07-26T15:31:55.622 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-07-26T15:31:55.624 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.650 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.033) 0:01:11.118 *********** 2021-07-26T15:31:55.688 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-07-26T15:31:55.690 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.716 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.066) 0:01:11.185 *********** 2021-07-26T15:31:55.734 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-07-26T15:31:55.736 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.759 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.042) 0:01:11.228 *********** 2021-07-26T15:31:55.787 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-07-26T15:31:55.789 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.825 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.065) 0:01:11.294 *********** 2021-07-26T15:31:55.834 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:31:55.836 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:55.874 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:55 +0000 (0:00:00.048) 0:01:11.342 *********** 2021-07-26T15:31:56.072 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:31:56.073 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013047", "end": "2021-07-26 15:31:56.285617", "rc": 0, "start": "2021-07-26 15:31:56.272570", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:31:56.097 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:56 +0000 (0:00:00.223) 0:01:11.565 *********** 2021-07-26T15:31:56.167 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-07-26T15:31:56.168 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:56.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:56 +0000 (0:00:00.093) 0:01:11.659 *********** 2021-07-26T15:31:56.280 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-07-26T15:31:56.282 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:56.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:56 +0000 (0:00:00.112) 0:01:11.772 *********** 2021-07-26T15:31:56.486 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-07-26T15:31:56.488 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:56.560 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:56.665 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:56.739 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:56.834 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:56.918 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:57.012 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:57.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.735) 0:01:12.508 *********** 2021-07-26T15:31:57.088 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:31:57.125 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.085) 0:01:12.593 *********** 2021-07-26T15:31:57.132 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:31:57.133 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.161 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.036) 0:01:12.629 *********** 2021-07-26T15:31:57.191 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.218 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.055) 0:01:12.685 *********** 2021-07-26T15:31:57.233 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-07-26T15:31:57.235 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.259 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.042) 0:01:12.727 *********** 2021-07-26T15:31:57.286 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.310 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.051) 0:01:12.779 *********** 2021-07-26T15:31:57.328 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-07-26T15:31:57.329 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.042) 0:01:12.821 *********** 2021-07-26T15:31:57.380 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.405 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.051) 0:01:12.873 *********** 2021-07-26T15:31:57.421 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-07-26T15:31:57.423 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.446 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.041) 0:01:12.914 *********** 2021-07-26T15:31:57.473 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.497 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.051) 0:01:12.966 *********** 2021-07-26T15:31:57.514 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-07-26T15:31:57.516 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.539 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.041) 0:01:13.007 *********** 2021-07-26T15:31:57.566 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:57.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:57 +0000 (0:00:00.051) 0:01:13.059 *********** 2021-07-26T15:31:58.187 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-07-26T15:31:58.188 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.498412", "end": "2021-07-26 15:31:58.509605", "rc": 0, "start": "2021-07-26 15:31:58.011193", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:58.220 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:00.628) 0:01:13.688 *********** 2021-07-26T15:31:58.289 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-07-26T15:31:58.291 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the hardware clock] ***************************************** changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.568600", "end": "2021-07-26 15:31:58.505722", "rc": 0, "start": "2021-07-26 15:31:57.937122", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:58.313 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:00.093) 0:01:13.782 *********** 2021-07-26T15:31:58.336 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:00.021) 0:01:13.803 *********** 2021-07-26T15:31:58.394 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-07-26T15:31:58.396 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:58.419 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:00.083) 0:01:13.887 *********** 2021-07-26T15:31:58.653 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-07-26T15:31:58.655 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.118005", "end": "2021-07-26 15:31:58.980768", "rc": 0, "start": "2021-07-26 15:31:58.862763", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:58.678 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:00.259) 0:01:14.147 *********** 2021-07-26T15:31:58.716 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.119531", "end": "2021-07-26 15:31:58.928586", "rc": 0, "start": "2021-07-26 15:31:58.809055", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:58.741 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:00.062) 0:01:14.210 *********** 2021-07-26T15:32:02.589 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-07-26T15:32:02.591 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:32:02.612 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:03.870) 0:01:18.080 *********** 2021-07-26T15:32:02.619 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:32:02.646 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.034) 0:01:18.114 *********** 2021-07-26T15:32:03.341 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-07-26T15:32:03.343 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:32:03.364 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.718) 0:01:18.833 *********** 2021-07-26T15:32:03.372 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:32:03.399 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.034) 0:01:18.867 *********** 2021-07-26T15:32:03.433 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-07-26T15:32:03.435 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.460 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.061) 0:01:18.928 *********** 2021-07-26T15:32:03.479 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.505 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.045) 0:01:18.974 *********** 2021-07-26T15:32:04.130 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-07-26T15:32:04.132 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:32:04.156 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.650) 0:01:19.625 *********** 2021-07-26T15:32:04.163 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:32:04.188 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.032) 0:01:19.657 *********** 2021-07-26T15:32:04.881 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-07-26T15:32:04.883 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:32:04.905 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.716) 0:01:20.374 *********** 2021-07-26T15:32:04.913 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:32:04.938 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.032) 0:01:20.406 *********** 2021-07-26T15:32:05.300 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:32:05.302 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:32:05.333 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:32:05.613 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:32:05.646 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:32:05.916 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:32:05.941 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:01.003) 0:01:21.410 *********** 2021-07-26T15:32:05.949 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:32:05.978 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.037) 0:01:21.447 *********** 2021-07-26T15:32:06.081 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-07-26T15:32:06.082 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:06.107 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.128) 0:01:21.575 *********** 2021-07-26T15:32:06.125 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:06.151 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.044) 0:01:21.619 *********** 2021-07-26T15:32:06.480 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-07-26T15:32:06.482 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:32:06.513 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:32:06.774 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:32:06.817 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:32:07.109 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313526.7854965-22937-202068919456167/source", "state": "file", "uid": 0} 2021-07-26T15:32:07.134 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.983) 0:01:22.603 *********** 2021-07-26T15:32:07.151 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313526.8338287-22940-142156410011839/source", "state": "file", "uid": 0} 2021-07-26T15:32:07.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.043) 0:01:22.646 *********** 2021-07-26T15:32:07.216 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-07-26T15:32:07.218 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:32:07.241 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.063) 0:01:22.709 *********** 2021-07-26T15:32:07.258 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:32:07.283 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.042) 0:01:22.752 *********** 2021-07-26T15:32:07.311 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-07-26T15:32:07.313 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.338 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.054) 0:01:22.806 *********** 2021-07-26T15:32:07.356 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.381 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.042) 0:01:22.849 *********** 2021-07-26T15:32:07.407 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-07-26T15:32:07.409 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:32:07.433 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.052) 0:01:22.901 *********** 2021-07-26T15:32:07.450 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:32:07.475 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.042) 0:01:22.944 *********** 2021-07-26T15:32:07.513 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-07-26T15:32:07.615 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} Monday 26 July 2021 15:32:07 +0000 (0:00:00.107) 0:01:23.051 *********** skipping: [smithi111.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x 2021-07-26T15:32:07.617 INFO:teuthology.task.ansible.out:86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.628 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.044) 0:01:23.096 *********** 2021-07-26T15:32:07.665 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.690 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.061) 0:01:23.158 *********** 2021-07-26T15:32:07.707 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.732 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.042) 0:01:23.200 *********** 2021-07-26T15:32:08.422 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-07-26T15:32:08.424 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:32:08.445 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.713) 0:01:23.914 *********** 2021-07-26T15:32:08.452 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:32:08.477 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.031) 0:01:23.945 *********** 2021-07-26T15:32:08.820 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-07-26T15:32:08.822 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:32:08.845 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.367) 0:01:24.312 *********** 2021-07-26T15:32:08.851 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:32:08.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.033) 0:01:24.346 *********** 2021-07-26T15:32:09.249 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:32:09.273 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.395) 0:01:24.742 *********** 2021-07-26T15:32:09.280 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:32:09.306 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.032) 0:01:24.774 *********** 2021-07-26T15:32:09.468 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-07-26T15:32:09.470 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:32:09.501 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:32:09.596 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:32:09.621 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.314) 0:01:25.089 *********** 2021-07-26T15:32:09.638 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:32:09.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.044) 0:01:25.133 *********** 2021-07-26T15:32:09.693 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.717 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.051) 0:01:25.185 *********** 2021-07-26T15:32:09.734 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.758 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.042) 0:01:25.227 *********** 2021-07-26T15:32:09.796 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-07-26T15:32:09.798 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:32:09.820 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.062) 0:01:25.289 *********** 2021-07-26T15:32:09.838 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:32:09.871 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.050) 0:01:25.339 *********** 2021-07-26T15:32:09.899 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-07-26T15:32:09.901 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.925 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.053) 0:01:25.393 *********** 2021-07-26T15:32:09.952 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.977 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.053) 0:01:25.446 *********** 2021-07-26T15:32:10.305 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-07-26T15:32:10.307 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:32:10.331 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.353) 0:01:25.800 *********** 2021-07-26T15:32:10.361 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:32:10.387 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.055) 0:01:25.855 *********** 2021-07-26T15:32:10.612 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-07-26T15:32:10.613 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:29:18 UTC", "ActiveEnterTimestampMonotonic": "15716814", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice nss-lookup.target -.mount systemd-tmpfiles-setup.service network.target var-run.mount systemd-journald.socket basic.target time-sync.target local-fs.target sysinit.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:29:18 UTC", "AssertTimestampMonotonic": "15707677", "Before": "shutdown.target plymouth-quit.service getty@tty1.service multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:29:18 UTC", "Co 2021-07-26T15:32:10.615 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15707677", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "844", "ExecMainStartTimestamp": "Mon 2021-07-26 15:29:18 UTC", "ExecMainStartTimestampMonotonic": "15716664", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:29:18 UTC] ; stop_time=[n/a] ; pid=844 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:29:18 UTC] ; stop_time=[n/a] ; pid=844 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:32:10.616 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:29:18 UTC", "InactiveExitTimestampMonotonic": "15716814", "InvocationID": "e5be1b7a90ed4972ae1e160b1dc64d43", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127802", "LimitNPROCSoft": "127802", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "844", "MemoryAccounting": "yes", "MemoryCurrent": "1339392", "MemoryD 2021-07-26T15:32:10.618 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:29:18 UTC", "StateChangeTimestampMonotonic": "15716814", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:32:10.619 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38340", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:32:10.637 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.250) 0:01:26.106 *********** 2021-07-26T15:32:10.648 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:30:35 UTC", "ActiveEnterTimestampMonotonic": "16190073", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target -.mount systemd-tmpfiles-setup.service nss-lookup.target time-sync.target network.target var-run.mount local-fs.target system.slice remote-fs.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:30:35 UTC", "AssertTimestampMonotonic": "16188162", "Before": "plymouth-quit.service getty@tty1.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:30:35 UTC", "Co 2021-07-26T15:32:10.650 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16188162", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "900", "ExecMainStartTimestamp": "Mon 2021-07-26 15:30:35 UTC", "ExecMainStartTimestampMonotonic": "16189913", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:30:35 UTC] ; stop_time=[n/a] ; pid=900 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:30:35 UTC] ; stop_time=[n/a] ; pid=900 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:32:10.652 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:30:35 UTC", "InactiveExitTimestampMonotonic": "16190073", "InvocationID": "1edc55f8ac6142079e50db9fb65eed96", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "900", "MemoryAccounting": "yes", "MemoryCurrent": "1400832", "MemoryD 2021-07-26T15:32:10.653 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:30:35 UTC", "StateChangeTimestampMonotonic": "16190073", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:32:10.655 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", 2021-07-26T15:32:10.655 INFO:teuthology.task.ansible.out: "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:32:10.682 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.044) 0:01:26.150 *********** 2021-07-26T15:32:10.709 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-07-26T15:32:10.710 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.733 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.051) 0:01:26.201 *********** 2021-07-26T15:32:10.750 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.774 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.041) 0:01:26.243 *********** 2021-07-26T15:32:10.801 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-07-26T15:32:10.803 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.829 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.054) 0:01:26.297 *********** 2021-07-26T15:32:10.846 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.871 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.041) 0:01:26.339 *********** 2021-07-26T15:32:10.898 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-07-26T15:32:10.899 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.923 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.052) 0:01:26.391 *********** 2021-07-26T15:32:10.940 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.966 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.043) 0:01:26.435 *********** 2021-07-26T15:32:10.993 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-07-26T15:32:10.995 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.018 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.051) 0:01:26.487 *********** 2021-07-26T15:32:11.035 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.060 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.041) 0:01:26.529 *********** 2021-07-26T15:32:11.087 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-07-26T15:32:11.089 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.112 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.051) 0:01:26.580 *********** 2021-07-26T15:32:11.132 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.157 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.044) 0:01:26.625 *********** 2021-07-26T15:32:11.184 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-07-26T15:32:11.185 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.209 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.051) 0:01:26.676 *********** 2021-07-26T15:32:11.225 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.250 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.041) 0:01:26.718 *********** 2021-07-26T15:32:11.277 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.053) 0:01:26.772 *********** 2021-07-26T15:32:11.321 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.346 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.042) 0:01:26.814 *********** 2021-07-26T15:32:11.374 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-07-26T15:32:11.376 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.402 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.055) 0:01:26.870 *********** 2021-07-26T15:32:11.419 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.444 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.042) 0:01:26.912 *********** 2021-07-26T15:32:11.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-07-26T15:32:11.475 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.496 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.052) 0:01:26.964 *********** 2021-07-26T15:32:11.513 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.538 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.042) 0:01:27.007 *********** 2021-07-26T15:32:11.565 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-07-26T15:32:11.567 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.590 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.051) 0:01:27.058 *********** 2021-07-26T15:32:11.607 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.042) 0:01:27.101 *********** 2021-07-26T15:32:11.659 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-07-26T15:32:11.661 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:32:11.685 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.052) 0:01:27.153 *********** 2021-07-26T15:32:11.702 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:32:11.727 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.042) 0:01:27.195 *********** 2021-07-26T15:32:11.764 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-07-26T15:32:11.766 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:32:11.790 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.063) 0:01:27.258 *********** 2021-07-26T15:32:11.808 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:32:11.834 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.043) 0:01:27.302 *********** 2021-07-26T15:32:11.872 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-07-26T15:32:11.873 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:32:11.898 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.063) 0:01:27.366 *********** 2021-07-26T15:32:11.916 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:32:11.942 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:11 +0000 (0:00:00.043) 0:01:27.410 *********** 2021-07-26T15:32:11.980 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-07-26T15:32:11.982 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:32:12.009 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.066) 0:01:27.477 *********** 2021-07-26T15:32:12.027 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:32:12.052 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.043) 0:01:27.521 *********** 2021-07-26T15:32:12.143 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-07-26T15:32:12.144 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:32:12.169 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.116) 0:01:27.637 *********** 2021-07-26T15:32:12.199 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:32:12.237 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.068) 0:01:27.706 *********** 2021-07-26T15:32:12.381 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-07-26T15:32:12.383 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:32:12.406 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.168) 0:01:27.874 *********** 2021-07-26T15:32:12.423 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:32:12.448 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.042) 0:01:27.917 *********** 2021-07-26T15:32:12.475 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-07-26T15:32:12.477 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:12.500 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.051) 0:01:27.969 *********** 2021-07-26T15:32:12.518 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:12.542 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.041) 0:01:28.010 *********** 2021-07-26T15:32:12.569 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-07-26T15:32:12.571 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:12.594 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.051) 0:01:28.062 *********** 2021-07-26T15:32:12.611 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:12.635 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.041) 0:01:28.104 *********** 2021-07-26T15:32:12.822 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-07-26T15:32:12.824 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:32:12.847 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.211) 0:01:28.315 *********** 2021-07-26T15:32:12.875 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:32:12.899 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:12 +0000 (0:00:00.051) 0:01:28.367 *********** 2021-07-26T15:32:13.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-07-26T15:32:13.297 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:32:13.319 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:13 +0000 (0:00:00.420) 0:01:28.787 *********** 2021-07-26T15:32:13.378 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:32:13.413 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:13 +0000 (0:00:00.094) 0:01:28.882 *********** 2021-07-26T15:32:13.423 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-07-26T15:32:13.424 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi018"}, "changed": false} 2021-07-26T15:32:13.464 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:13 +0000 (0:00:00.050) 0:01:28.932 *********** 2021-07-26T15:32:13.485 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi111"}, "changed": false} 2021-07-26T15:32:13.511 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:13 +0000 (0:00:00.047) 0:01:28.979 *********** 2021-07-26T15:32:14.357 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-07-26T15:32:14.359 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi111.front.sepia.ceph.com", "ansible_hostname": "smithi111", "ansible_nodename": "smithi111"}, "changed": true, "name": "smithi111"} changed: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi018.front.sepia.ceph.com", "ansible_hostname": "smithi018", "ansible_nodename": "smithi018"}, "changed": true, "name": "smithi018"} 2021-07-26T15:32:14.380 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:14 +0000 (0:00:00.869) 0:01:29.849 *********** 2021-07-26T15:32:14.402 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:14 +0000 (0:00:00.021) 0:01:29.870 *********** 2021-07-26T15:32:14.752 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-07-26T15:32:14.754 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:32:14.776 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:14 +0000 (0:00:00.374) 0:01:30.244 *********** 2021-07-26T15:32:14.783 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:32:14.808 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:14 +0000 (0:00:00.032) 0:01:30.277 *********** 2021-07-26T15:32:15.163 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-07-26T15:32:15.164 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:32:15.186 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.377) 0:01:30.655 *********** 2021-07-26T15:32:15.205 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:32:15.231 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.044) 0:01:30.699 *********** 2021-07-26T15:32:15.748 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi111.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:32:15.748 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:32:15.772 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.541) 0:01:31.241 *********** 2021-07-26T15:32:15.796 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.023) 0:01:31.264 *********** 2021-07-26T15:32:15.834 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-07-26T15:32:15.836 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.064) 0:01:31.328 *********** 2021-07-26T15:32:15.867 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.893 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.033) 0:01:31.362 *********** 2021-07-26T15:32:15.932 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:32:15.933 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.958 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.064) 0:01:31.426 *********** 2021-07-26T15:32:15.966 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.992 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:15 +0000 (0:00:00.033) 0:01:31.460 *********** 2021-07-26T15:32:16.030 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:32:16.031 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.054 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.062) 0:01:31.522 *********** 2021-07-26T15:32:16.071 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.096 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.041) 0:01:31.564 *********** 2021-07-26T15:32:16.124 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-07-26T15:32:16.125 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.152 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.055) 0:01:31.620 *********** 2021-07-26T15:32:16.169 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.194 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.042) 0:01:31.662 *********** 2021-07-26T15:32:16.221 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:32:16.223 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.247 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.052) 0:01:31.715 *********** 2021-07-26T15:32:16.264 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.042) 0:01:31.758 *********** 2021-07-26T15:32:16.306 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:32:16.309 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.335 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.046) 0:01:31.804 *********** 2021-07-26T15:32:16.354 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.381 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.044) 0:01:31.849 *********** 2021-07-26T15:32:16.429 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:32:16.431 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.455 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.073) 0:01:31.923 *********** 2021-07-26T15:32:16.461 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.488 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.033) 0:01:31.957 *********** 2021-07-26T15:32:16.529 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.553 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.064) 0:01:32.022 *********** 2021-07-26T15:32:16.560 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.586 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.032) 0:01:32.054 *********** 2021-07-26T15:32:16.634 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:16.635 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.657 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.071) 0:01:32.126 *********** 2021-07-26T15:32:16.664 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.691 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.033) 0:01:32.159 *********** 2021-07-26T15:32:16.730 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.762 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.071) 0:01:32.231 *********** 2021-07-26T15:32:16.770 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.802 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.039) 0:01:32.271 *********** 2021-07-26T15:32:16.831 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-07-26T15:32:16.833 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.057) 0:01:32.329 *********** 2021-07-26T15:32:16.878 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.906 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.043) 0:01:32.372 *********** 2021-07-26T15:32:16.921 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-07-26T15:32:16.947 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.042) 0:01:32.415 *********** 2021-07-26T15:32:16.989 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:16 +0000 (0:00:00.042) 0:01:32.458 *********** 2021-07-26T15:32:17.008 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-07-26T15:32:17.034 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.044) 0:01:32.502 *********** 2021-07-26T15:32:17.109 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.074) 0:01:32.576 *********** 2021-07-26T15:32:17.116 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-07-26T15:32:17.143 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.034) 0:01:32.611 *********** 2021-07-26T15:32:17.206 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.062) 0:01:32.674 *********** 2021-07-26T15:32:17.223 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.248 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.042) 0:01:32.716 *********** 2021-07-26T15:32:17.297 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.327 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.079) 0:01:32.796 *********** 2021-07-26T15:32:17.333 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-07-26T15:32:17.335 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.367 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.039) 0:01:32.835 *********** 2021-07-26T15:32:17.406 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.408 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.431 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.064) 0:01:32.900 *********** 2021-07-26T15:32:17.437 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-07-26T15:32:17.439 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.465 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.033) 0:01:32.933 *********** 2021-07-26T15:32:17.493 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.519 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.054) 0:01:32.988 *********** 2021-07-26T15:32:17.537 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.562 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.042) 0:01:33.030 *********** 2021-07-26T15:32:17.580 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.605 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.042) 0:01:33.073 *********** 2021-07-26T15:32:17.642 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-07-26T15:32:17.644 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.667 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.062) 0:01:33.135 *********** 2021-07-26T15:32:17.684 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.710 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.042) 0:01:33.178 *********** 2021-07-26T15:32:17.737 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-07-26T15:32:17.740 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.773 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.062) 0:01:33.241 *********** 2021-07-26T15:32:17.793 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.820 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.047) 0:01:33.289 *********** 2021-07-26T15:32:17.848 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-07-26T15:32:17.849 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.873 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.052) 0:01:33.341 *********** 2021-07-26T15:32:17.891 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.916 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.042) 0:01:33.384 *********** 2021-07-26T15:32:17.943 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-07-26T15:32:17.945 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.975 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:00.059) 0:01:33.443 *********** 2021-07-26T15:32:17.994 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.020 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.045) 0:01:33.489 *********** 2021-07-26T15:32:18.040 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:32:18.041 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.066 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.045) 0:01:33.535 *********** 2021-07-26T15:32:18.094 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.119 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.052) 0:01:33.587 *********** 2021-07-26T15:32:18.137 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:32:18.138 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.163 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.043) 0:01:33.631 *********** 2021-07-26T15:32:18.191 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.216 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.053) 0:01:33.684 *********** 2021-07-26T15:32:18.234 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.260 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.043) 0:01:33.728 *********** 2021-07-26T15:32:18.288 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.313 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.053) 0:01:33.781 *********** 2021-07-26T15:32:18.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-07-26T15:32:18.331 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.354 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.041) 0:01:33.822 *********** 2021-07-26T15:32:18.383 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.407 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.053) 0:01:33.876 *********** 2021-07-26T15:32:18.434 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:32:18.436 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.459 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.051) 0:01:33.927 *********** 2021-07-26T15:32:18.487 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.511 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.052) 0:01:33.980 *********** 2021-07-26T15:32:18.529 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:32:18.530 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.560 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.048) 0:01:34.029 *********** 2021-07-26T15:32:18.590 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.629 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.068) 0:01:34.097 *********** 2021-07-26T15:32:18.649 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-07-26T15:32:18.650 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.678 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.049) 0:01:34.146 *********** 2021-07-26T15:32:18.698 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.724 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.046) 0:01:34.193 *********** 2021-07-26T15:32:18.751 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-07-26T15:32:18.753 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.777 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.052) 0:01:34.246 *********** 2021-07-26T15:32:18.795 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.821 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.043) 0:01:34.289 *********** 2021-07-26T15:32:18.838 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.863 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.042) 0:01:34.332 *********** 2021-07-26T15:32:18.891 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.916 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.052) 0:01:34.384 *********** 2021-07-26T15:32:18.933 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-07-26T15:32:18.936 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.959 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.042) 0:01:34.427 *********** 2021-07-26T15:32:18.987 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.012 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.052) 0:01:34.480 *********** 2021-07-26T15:32:19.029 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-07-26T15:32:19.030 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.054 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.042) 0:01:34.523 *********** 2021-07-26T15:32:19.085 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.109 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.054) 0:01:34.577 *********** 2021-07-26T15:32:19.125 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-07-26T15:32:19.127 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.154 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.045) 0:01:34.622 *********** 2021-07-26T15:32:19.182 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.207 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.052) 0:01:34.675 *********** 2021-07-26T15:32:19.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-07-26T15:32:19.226 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.252 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.045) 0:01:34.721 *********** 2021-07-26T15:32:19.255 INFO:teuthology.task.ansible.out: 2021-07-26T15:32:19.273 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.299 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.046) 0:01:34.767 *********** 2021-07-26T15:32:19.326 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-07-26T15:32:19.328 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.351 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.052) 0:01:34.820 *********** 2021-07-26T15:32:19.369 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.398 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.047) 0:01:34.867 *********** 2021-07-26T15:32:19.533 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-07-26T15:32:19.535 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005314", "end": "2021-07-26 15:32:19.753312", "rc": 0, "start": "2021-07-26 15:32:19.747998", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.559 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.160) 0:01:35.027 *********** 2021-07-26T15:32:19.598 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005349", "end": "2021-07-26 15:32:19.926740", "rc": 0, "start": "2021-07-26 15:32:19.921391", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.626 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.066) 0:01:35.093 *********** 2021-07-26T15:32:19.792 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-07-26T15:32:19.816 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.190) 0:01:35.284 *********** 2021-07-26T15:32:19.889 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.073) 0:01:35.357 *********** 2021-07-26T15:32:20.370 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-07-26T15:32:20.372 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:32:20.393 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.504) 0:01:35.862 *********** 2021-07-26T15:32:20.462 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:32:20.463 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.490 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.096) 0:01:35.959 *********** 2021-07-26T15:32:20.514 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.023) 0:01:35.982 *********** 2021-07-26T15:32:20.583 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.606 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.091) 0:01:36.074 *********** 2021-07-26T15:32:21.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-07-26T15:32:21.871 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:32:21.943 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:32:22.845 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:32:22.870 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:22 +0000 (0:00:02.264) 0:01:38.338 *********** 2021-07-26T15:32:22.994 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:32:23.019 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:23 +0000 (0:00:00.149) 0:01:38.488 *********** 2021-07-26T15:32:23.770 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-07-26T15:32:23.772 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:32:23.905 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:23 +0000 (0:00:00.885) 0:01:39.373 *********** 2021-07-26T15:32:23.912 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:32:23.938 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:23 +0000 (0:00:00.033) 0:01:39.407 *********** 2021-07-26T15:32:23.966 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-07-26T15:32:23.991 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:23 +0000 (0:00:00.052) 0:01:39.459 *********** 2021-07-26T15:32:24.034 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.042) 0:01:39.502 *********** 2021-07-26T15:32:24.206 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-07-26T15:32:24.208 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034070", "end": "2021-07-26 15:32:24.535206", "rc": 0, "start": "2021-07-26 15:32:24.501136", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:24.231 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.197) 0:01:39.699 *********** 2021-07-26T15:32:24.259 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035889", "end": "2021-07-26 15:32:24.467391", "rc": 0, "start": "2021-07-26 15:32:24.431502", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:24.284 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.053) 0:01:39.752 *********** 2021-07-26T15:32:26.486 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-07-26T15:32:26.488 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:32:26.512 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:02.227) 0:01:41.980 *********** 2021-07-26T15:32:26.572 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:32:26.597 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.085) 0:01:42.066 *********** 2021-07-26T15:32:37.986 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-07-26T15:32:37.988 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:32:37.990 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:32:37.992 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:32:38.012 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:11.414) 0:01:53.480 *********** 2021-07-26T15:32:38.031 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:32:38.033 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:32:38.034 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:32:38.057 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.045) 0:01:53.526 *********** 2021-07-26T15:33:02.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:33:02.207 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\n 2021-07-26T15:33:02.209 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (4098 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6 2021-07-26T15:33:02.211 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-07-26T15:33:02.212 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB] 2021-07-26T15:33:02.214 INFO:teuthology.task.ansible.out:", "Fetched 3866 kB in 1s (4098 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-07-26T15:33:02.216 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:33:02.232 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:02 +0000 (0:00:24.174) 0:02:17.700 *********** 2021-07-26T15:33:02.315 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:02.337 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:02 +0000 (0:00:00.105) 0:02:17.806 *********** 2021-07-26T15:33:03.017 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* changed: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http:/ 2021-07-26T15:33:03.019 INFO:teuthology.task.ansible.out:/archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (4099 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.) 2021-07-26T15:33:03.021 INFO:teuthology.task.ansible.out:\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state inform 2021-07-26T15:33:03.022 INFO:teuthology.task.ansible.out:ation...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu 2021-07-26T15:33:03.025 INFO:teuthology.task.ansible.out:.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]", "Fetched 3866 kB in 1s (4099 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading databa 2021-07-26T15:33:03.026 INFO:teuthology.task.ansible.out:se ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:33:03.042 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.704) 0:02:18.511 *********** 2021-07-26T15:33:03.121 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:03.151 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.106) 0:02:18.618 *********** 2021-07-26T15:33:16.175 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:33:16.176 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:33:16.178 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 2s (10.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:33:16.180 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:33:16.182 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 2s (10.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:33:16.183 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:33:16.185 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:33:16.202 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:16 +0000 (0:00:13.052) 0:02:31.670 *********** 2021-07-26T15:33:16.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:33:16.936 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:16 +0000 (0:00:00.732) 0:02:32.403 *********** 2021-07-26T15:33:17.507 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:33:17.509 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:33:17.511 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 2s (11.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:33:17.513 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:33:17.516 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 2s (11.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparin 2021-07-26T15:33:17.516 INFO:teuthology.task.ansible.out:g to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:33:17.518 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:33:17.521 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:33:17.541 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:17 +0000 (0:00:00.606) 0:02:33.009 *********** 2021-07-26T15:33:17.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:33:17.650 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:33:17.686 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:17 +0000 (0:00:00.145) 0:02:33.155 *********** 2021-07-26T15:33:17.865 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:33:17.890 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:17 +0000 (0:00:00.202) 0:02:33.358 *********** 2021-07-26T15:33:17.962 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:17.989 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:17 +0000 (0:00:00.100) 0:02:33.458 *********** 2021-07-26T15:33:18.174 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-07-26T15:33:18.176 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:33:18.208 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:18 +0000 (0:00:00.218) 0:02:33.676 *********** 2021-07-26T15:33:18.279 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:33:18.304 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:18 +0000 (0:00:00.096) 0:02:33.773 *********** 2021-07-26T15:33:18.597 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:33:18.599 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:33:18.622 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:18 +0000 (0:00:00.317) 0:02:34.090 *********** 2021-07-26T15:33:18.839 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-07-26T15:33:18.841 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:33:18.866 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:18 +0000 (0:00:00.244) 0:02:34.334 *********** 2021-07-26T15:33:19.012 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:33:19.014 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:33:19.036 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.170) 0:02:34.505 *********** 2021-07-26T15:33:19.054 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-07-26T15:33:19.056 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:33:19.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.042) 0:02:34.547 *********** 2021-07-26T15:33:19.224 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-07-26T15:33:19.226 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:33:19.253 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.173) 0:02:34.721 *********** 2021-07-26T15:33:19.325 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-07-26T15:33:19.327 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:19.348 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.095) 0:02:34.817 *********** 2021-07-26T15:33:19.412 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-07-26T15:33:19.413 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:32:55 UTC", "ActiveEnterTimestampMonotonic": "156391342", "ActiveExitTimestamp": "Mon 2021-07-26 15:32:55 UTC", "ActiveExitTimestampMonotonic": "156319245", "ActiveState": "active", "After": "systemd-journald.socket -.mount system.slice network.target remote-fs.target systemd-tmpfiles-setup.service sysinit.target nss-lookup.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:32:55 UTC", "AssertTimestampMonotonic": "156363055", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:32:55 UTC", "ConditionTimestampMonotonic": "156363055", "ConfigurationDirec 2021-07-26T15:33:19.415 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6550", "ExecMainStartTimestamp": "Mon 2021-07-26 15:32:55 UTC", "ExecMainStartTimestampMonotonic": "156391312", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-07-26T15:33:19.416 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:32:55 UTC", "InactiveEnterTimestampMonotonic": "156361856", "InactiveExitTimestamp": "Mon 2021-07-26 15:32:55 UTC", "InactiveExitTimestampMonotonic": "156365018", "InvocationID": "65b4c3ec04b2414d88ccb2b6bff50786", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6550", "MemoryAccounting": "yes", "MemoryCurrent": "6823936", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-07-26T15:33:19.418 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:32:55 UTC", "StateChangeTimestampMonotonic": "156391342", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-07-26T15:33:19.420 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:33:19.438 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.090) 0:02:34.907 *********** 2021-07-26T15:33:19.519 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:19.546 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.107) 0:02:35.014 *********** 2021-07-26T15:33:19.552 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-07-26T15:33:19.554 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:33:19.586 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.036) 0:02:35.051 *********** 2021-07-26T15:33:19.610 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:33:19.612 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:19.637 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.054) 0:02:35.105 *********** 2021-07-26T15:33:19.710 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:19.734 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.097) 0:02:35.202 *********** 2021-07-26T15:33:19.813 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:33:19.815 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:19.836 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.101) 0:02:35.304 *********** 2021-07-26T15:33:19.905 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:33:19.907 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:19.933 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:19 +0000 (0:00:00.097) 0:02:35.402 *********** 2021-07-26T15:33:20.002 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:33:20.004 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.027 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.093) 0:02:35.496 *********** 2021-07-26T15:33:20.050 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.022) 0:02:35.519 *********** 2021-07-26T15:33:20.127 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:33:20.129 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.154 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.100) 0:02:35.619 *********** 2021-07-26T15:33:20.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:33:20.242 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi018.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:33:20.265 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.114) 0:02:35.733 *********** 2021-07-26T15:33:20.286 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.021) 0:02:35.755 *********** 2021-07-26T15:33:20.357 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:20.359 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.382 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.095) 0:02:35.850 *********** 2021-07-26T15:33:20.453 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:33:20.483 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.100) 0:02:35.951 *********** 2021-07-26T15:33:20.491 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:33:20.492 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.517 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.034) 0:02:35.986 *********** 2021-07-26T15:33:20.589 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.611 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.094) 0:02:36.080 *********** 2021-07-26T15:33:20.681 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:33:20.683 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.706 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.094) 0:02:36.175 *********** 2021-07-26T15:33:20.776 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:33:20.778 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.779 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-07-26T15:33:20.781 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:32:56 UTC", "ActiveEnterTimestampMonotonic": "233048375", "ActiveExitTimestamp": "Mon 2021-07-26 15:32:55 UTC", "ActiveExitTimestampMonotonic": "232962242", "ActiveState": "active", "After": "system.slice -.mount systemd-tmpfiles-setup.service sysinit.target basic.target systemd-journald.socket remote-fs.target nss-lookup.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:32:56 UTC", "AssertTimestampMonotonic": "233014174", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:32:56 UTC", "ConditionTimestampMonotonic": "233014174", "ConfigurationDirec 2021-07-26T15:33:20.782 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6470", "ExecMainStartTimestamp": "Mon 2021-07-26 15:32:56 UTC", "ExecMainStartTimestampMonotonic": "233048341", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-07-26T15:33:20.784 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:32:56 UTC", "InactiveEnterTimestampMonotonic": "233012838", "InactiveExitTimestamp": "Mon 2021-07-26 15:32:56 UTC", "InactiveExitTimestampMonotonic": "233016737", "InvocationID": "92e2d9054ae446d092add968ff09dc89", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127802", "LimitNPROCSoft": "127802", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6470", "MemoryAccounting": "yes", "MemoryCurrent": "6746112", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-07-26T15:33:20.786 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:32:56 UTC", "StateChangeTimestampMonotonic": "233048375", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-07-26T15:33:20.788 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38340", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:33:20.804 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.097) 0:02:36.273 *********** 2021-07-26T15:33:20.826 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.021) 0:02:36.294 *********** 2021-07-26T15:33:20.875 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:33:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.901 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.074) 0:02:36.369 *********** 2021-07-26T15:33:20.907 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:33:20.909 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.934 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.033) 0:02:36.402 *********** 2021-07-26T15:33:20.972 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:33:20.974 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:20.997 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:20 +0000 (0:00:00.062) 0:02:36.465 *********** 2021-07-26T15:33:21.014 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:33:21.016 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.041 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.044) 0:02:36.509 *********** 2021-07-26T15:33:21.069 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.094 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.052) 0:02:36.562 *********** 2021-07-26T15:33:21.111 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:33:21.113 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.140 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.046) 0:02:36.608 *********** 2021-07-26T15:33:21.169 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.194 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.053) 0:02:36.662 *********** 2021-07-26T15:33:21.210 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:33:21.212 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.236 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.042) 0:02:36.704 *********** 2021-07-26T15:33:21.264 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:33:21.266 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.302 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.060) 0:02:36.765 *********** 2021-07-26T15:33:21.316 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.340 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.043) 0:02:36.809 *********** 2021-07-26T15:33:21.369 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.394 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.053) 0:02:36.862 *********** 2021-07-26T15:33:21.412 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:33:21.415 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.443 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.045) 0:02:36.908 *********** 2021-07-26T15:33:21.479 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:33:21.481 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.506 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.066) 0:02:36.974 *********** 2021-07-26T15:33:21.523 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:33:21.525 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.550 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.044) 0:02:37.018 *********** 2021-07-26T15:33:21.578 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:33:21.580 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.605 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.054) 0:02:37.073 *********** 2021-07-26T15:33:21.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:33:21.625 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.650 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.044) 0:02:37.118 *********** 2021-07-26T15:33:21.677 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:21.685 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.702 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.052) 0:02:37.171 *********** 2021-07-26T15:33:21.732 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.761 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.058) 0:02:37.229 *********** 2021-07-26T15:33:21.779 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:33:21.780 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.805 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.044) 0:02:37.274 *********** 2021-07-26T15:33:21.835 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:33:21.837 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.867 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.061) 0:02:37.335 *********** 2021-07-26T15:33:21.886 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:33:21.887 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.922 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.055) 0:02:37.391 *********** 2021-07-26T15:33:21.941 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:33:21.943 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:21.967 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:21 +0000 (0:00:00.044) 0:02:37.435 *********** 2021-07-26T15:33:21.991 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:33:21.993 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.022 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.055) 0:02:37.491 *********** 2021-07-26T15:33:22.052 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:33:22.054 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.077 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.054) 0:02:37.545 *********** 2021-07-26T15:33:22.104 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:33:22.106 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.129 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.052) 0:02:37.597 *********** 2021-07-26T15:33:22.146 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-07-26T15:33:22.148 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.173 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.043) 0:02:37.641 *********** 2021-07-26T15:33:22.201 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:33:22.203 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.227 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.053) 0:02:37.694 *********** 2021-07-26T15:33:22.306 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.329 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.103) 0:02:37.798 *********** 2021-07-26T15:33:22.380 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:33:22.405 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.075) 0:02:37.873 *********** 2021-07-26T15:33:22.422 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:33:22.424 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.452 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.046) 0:02:37.920 *********** 2021-07-26T15:33:22.523 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.548 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.096) 0:02:38.016 *********** 2021-07-26T15:33:22.616 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:33:22.618 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.640 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.091) 0:02:38.108 *********** 2021-07-26T15:33:22.700 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:33:22.702 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.723 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.083) 0:02:38.192 *********** 2021-07-26T15:33:22.788 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:33:22.810 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.086) 0:02:38.278 *********** 2021-07-26T15:33:22.817 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.843 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.033) 0:02:38.311 *********** 2021-07-26T15:33:22.883 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.909 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.065) 0:02:38.377 *********** 2021-07-26T15:33:22.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:33:22.938 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:22.961 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:22 +0000 (0:00:00.052) 0:02:38.430 *********** 2021-07-26T15:33:23.044 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:33:23.045 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:23.074 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.112) 0:02:38.542 *********** 2021-07-26T15:33:23.143 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:23.169 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.095) 0:02:38.637 *********** 2021-07-26T15:33:23.249 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:33:23.251 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:23.273 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.104) 0:02:38.742 *********** 2021-07-26T15:33:23.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-07-26T15:33:23.302 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:33:23.325 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.051) 0:02:38.794 *********** 2021-07-26T15:33:23.354 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:23.382 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.057) 0:02:38.851 *********** 2021-07-26T15:33:23.454 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-07-26T15:33:23.456 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:23.491 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.108) 0:02:38.959 *********** 2021-07-26T15:33:23.682 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:33:23.712 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.221) 0:02:39.180 *********** 2021-07-26T15:33:23.719 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-07-26T15:33:23.721 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:33:23.747 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:23 +0000 (0:00:00.034) 0:02:39.215 *********** 2021-07-26T15:33:24.095 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:33:24.096 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:33:24.119 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.372) 0:02:39.587 *********** 2021-07-26T15:33:24.120 INFO:teuthology.task.ansible.out: 2021-07-26T15:33:24.149 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:33:24.173 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.054) 0:02:39.642 *********** 2021-07-26T15:33:24.190 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:24.217 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.042) 0:02:39.685 *********** 2021-07-26T15:33:24.372 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-07-26T15:33:24.374 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:33:24.400 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.183) 0:02:39.868 *********** 2021-07-26T15:33:24.477 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:24.497 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.097) 0:02:39.965 *********** 2021-07-26T15:33:24.566 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-07-26T15:33:24.568 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:24.589 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.092) 0:02:40.058 *********** 2021-07-26T15:33:24.591 INFO:teuthology.task.ansible.out: 2021-07-26T15:33:24.606 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-07-26T15:33:24.608 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:33:24.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.042) 0:02:40.100 *********** 2021-07-26T15:33:24.661 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-07-26T15:33:24.667 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:24.691 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.058) 0:02:40.159 *********** 2021-07-26T15:33:24.760 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-07-26T15:33:24.761 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:24.783 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.092) 0:02:40.252 *********** 2021-07-26T15:33:24.853 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:24.877 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.093) 0:02:40.345 *********** 2021-07-26T15:33:24.953 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:24.955 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:33:24.976 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:24 +0000 (0:00:00.099) 0:02:40.445 *********** 2021-07-26T15:33:25.015 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-07-26T15:33:25.017 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:33:25.040 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.063) 0:02:40.508 *********** 2021-07-26T15:33:25.069 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi111.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.085 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.117 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.119 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi111.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.130 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.132 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.142 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.144 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.172 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.131) 0:02:40.640 *********** 2021-07-26T15:33:25.423 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-07-26T15:33:25.425 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003260", "end": "2021-07-26 15:33:25.402497", "rc": 0, "start": "2021-07-26 15:33:25.399237", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:33:25.451 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.278) 0:02:40.919 *********** 2021-07-26T15:33:25.458 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-07-26T15:33:25.460 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:33:25.485 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.034) 0:02:40.954 *********** 2021-07-26T15:33:25.524 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.552 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.066) 0:02:41.020 *********** 2021-07-26T15:33:25.642 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-07-26T15:33:25.643 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.666 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.114) 0:02:41.135 *********** 2021-07-26T15:33:25.685 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-07-26T15:33:25.686 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:33:25.721 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.054) 0:02:41.189 *********** 2021-07-26T15:33:25.750 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.779 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.058) 0:02:41.248 *********** 2021-07-26T15:33:25.818 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.845 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.065) 0:02:41.313 *********** 2021-07-26T15:33:25.847 INFO:teuthology.task.ansible.out: 2021-07-26T15:33:25.915 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:25.939 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:25 +0000 (0:00:00.094) 0:02:41.408 *********** 2021-07-26T15:33:26.010 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.035 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.094) 0:02:41.503 *********** 2021-07-26T15:33:26.109 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-07-26T15:33:26.111 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.135 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.100) 0:02:41.604 *********** 2021-07-26T15:33:26.206 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-07-26T15:33:26.208 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.230 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.093) 0:02:41.698 *********** 2021-07-26T15:33:26.329 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:26.331 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:33:26.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.123) 0:02:41.821 *********** 2021-07-26T15:33:26.455 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi018.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.466 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.477 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.489 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:33:26.491 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi018.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.515 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.162) 0:02:41.984 *********** 2021-07-26T15:33:26.526 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi018.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.536 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.550 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.571 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.573 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.585 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.587 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-07-26T15:33:26.588 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:26.613 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.097) 0:02:42.081 *********** 2021-07-26T15:33:26.634 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.021) 0:02:42.102 *********** 2021-07-26T15:33:26.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:33:26.716 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item={'block_used': 13859354, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235754, 'size_available': 926661648384, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235754, "block_size": 4096, "block_total": 240095108, "block_used": 13859354, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661648384, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:33:26.739 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.105) 0:02:42.208 *********** 2021-07-26T15:33:26.863 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-07-26T15:33:26.865 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003735", "end": "2021-07-26 15:33:26.836825", "rc": 0, "start": "2021-07-26 15:33:26.833090", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:33:26.892 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.153) 0:02:42.361 *********** 2021-07-26T15:33:26.942 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-07-26T15:33:26.944 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009394", "end": "2021-07-26 15:33:27.270979", "rc": 0, "start": "2021-07-26 15:33:27.261585", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:26.971 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:26 +0000 (0:00:00.078) 0:02:42.439 *********** 2021-07-26T15:33:26.990 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-07-26T15:33:26.992 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:27.019 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:27 +0000 (0:00:00.047) 0:02:42.487 *********** 2021-07-26T15:33:27.056 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:33:27.058 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'block_used': 13859354, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235754, 'size_available': 926661648384, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235754, "block_size": 4096, "block_total": 240095108, "block_used": 13859354, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661648384, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:27.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:27 +0000 (0:00:00.063) 0:02:42.551 *********** 2021-07-26T15:33:27.100 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-07-26T15:33:27.102 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:27.125 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:27 +0000 (0:00:00.042) 0:02:42.594 *********** 2021-07-26T15:33:27.153 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:33:27.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:27 +0000 (0:00:00.052) 0:02:42.646 *********** 2021-07-26T15:33:27.206 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:27.230 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:27 +0000 (0:00:00.052) 0:02:42.699 *********** 2021-07-26T15:33:27.270 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:33:27.271 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:27.960 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:33:27.982 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:27 +0000 (0:00:00.751) 0:02:43.451 *********** 2021-07-26T15:33:28.053 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-07-26T15:33:28.055 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:28.076 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:28 +0000 (0:00:00.093) 0:02:43.545 *********** 2021-07-26T15:33:28.167 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:33:28.169 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item={'block_used': 13859374, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235734, 'size_available': 926661566464, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150121, 'block_size': 4096, 'inode_available': 60904855}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235734, "block_size": 4096, "block_total": 240095108, "block_used": 13859374, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904855, "inode_total": 61054976, "inode_used": 150121, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661566464, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:33:28.192 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:28 +0000 (0:00:00.115) 0:02:43.661 *********** 2021-07-26T15:33:28.388 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-07-26T15:33:28.390 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010153", "end": "2021-07-26 15:33:28.370512", "rc": 0, "start": "2021-07-26 15:33:28.360359", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:28.412 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:28 +0000 (0:00:00.219) 0:02:43.880 *********** 2021-07-26T15:33:28.501 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:33:28.503 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'block_used': 13859374, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235734, 'size_available': 926661566464, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150121, 'block_size': 4096, 'inode_available': 60904855}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235734, "block_size": 4096, "block_total": 240095108, "block_used": 13859374, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904855, "inode_total": 61054976, "inode_used": 150121, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661566464, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:28.529 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:28 +0000 (0:00:00.117) 0:02:43.998 *********** 2021-07-26T15:33:28.599 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:33:28.634 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:28 +0000 (0:00:00.104) 0:02:44.102 *********** 2021-07-26T15:33:28.729 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:33:28.731 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:29.064 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6u9GfTBDqx9qzstYT0sk3fplx3oz7fS3d'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.662333", "end": "2021-07-26 15:33:29.388423", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6u9GfTBDqx9qzstYT0sk3fplx3oz7fS3d"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:27.726090", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:29.077 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:29.078 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:30.333 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6jYc2DPcIcb2glRmdCpjNgCrR3jsa0WXx'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.120576", "end": "2021-07-26 15:33:30.654347", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6jYc2DPcIcb2glRmdCpjNgCrR3jsa0WXx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:29.533771", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:30.335 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QLQG', 'wwn-0x5000c50091e11660'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QLQG-part1', 'wwn-0x5000c50091e11660-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e11660', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QLQG', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QLQG", "wwn-0x5000c50091e11660"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QLQG-part1", "wwn-0x5000c50091e11660-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QLQG", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e11660"}}, 2021-07-26T15:33:30.336 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:33:30.378 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWvlGGvx39kKFgDNYS8tnKHUmc3vUk7VjE'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.523106", "end": "2021-07-26 15:33:30.353628", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWvlGGvx39kKFgDNYS8tnKHUmc3vUk7VjE"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:28.830522", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:30.390 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:30.401 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:31.648 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIq6ucQbLVLgnot9l38lOUpZxbPTxaUmX'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.110799", "end": "2021-07-26 15:33:31.613161", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIq6ucQbLVLgnot9l38lOUpZxbPTxaUmX"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:30.502362", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:31.650 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQDQ', 'wwn-0x5000c500871a8c35'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQDQ-part1', 'wwn-0x5000c500871a8c35-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a8c35', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQDQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQDQ", "wwn-0x5000c500871a8c35"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQDQ-part1", "wwn-0x5000c500871a8c35-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQDQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8c35"}}, 2021-07-26T15:33:31.651 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ceeGR3-Mlur-f41y-EHkH-DAV0-HlNE-Y0nz5y', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN', 'nvme-nvme.8086-50484654363230343030565a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.185361", "end": "2021-07-26 15:33:31.976318", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ceeGR3-Mlur-f41y-EHkH-DAV0-HlNE-Y0nz5y", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN", "nvme-nvme.8086-50484654363230343030565a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:30.790957", "stderr": "", "stderr_lines": [], "stdout": "Creating 2021-07-26T15:33:31.653 INFO:teuthology.task.ansible.out:new GPT entries in memory.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:31.664 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:32.919 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68G6lNbKIAJbWQ7cGiQeYyStY4pC9qGc0'], 'uuids': ['0d731a09-39bb-41bd-aa69-d3ca329183a2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.120308", "end": "2021-07-26 15:33:33.238556", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68G6lNbKIAJbWQ7cGiQeYyStY4pC9qGc0"], "labels": [], "masters": [], "uuids": ["0d731a09-39bb-41bd-aa69-d3ca329183a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:32.118248", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:32.920 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:32.936 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:32.956 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-sZLAQx-2kxW-9Ojc-ZdEO-FTNH-69zx-VgrKC9', 'nvme-INTEL_SSDPED1D480GA_PHMB75120091480DGN', 'nvme-nvme.8086-50484d42373531323030393134383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.165485", "end": "2021-07-26 15:33:32.920438", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-sZLAQx-2kxW-9Ojc-ZdEO-FTNH-69zx-VgrKC9", "nvme-INTEL_SSDPED1D480GA_PHMB75120091480DGN", "nvme-nvme.8086-50484d42373531323030393134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:31.754953", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You 2021-07-26T15:33:32.958 INFO:teuthology.task.ansible.out:may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:32.967 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:34.210 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68ytc4gDK41dZYvUy2rVBI1MWv4Lm6b4K'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.143173", "end": "2021-07-26 15:33:34.528573", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68ytc4gDK41dZYvUy2rVBI1MWv4Lm6b4K"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:33.385400", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:34.212 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:34.243 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIBtkA9vdDPmcZhC0grI3Fceb0UTqFZy4'], 'uuids': ['681b7fcf-8075-4a4e-8242-233f62044c57']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.143259", "end": "2021-07-26 15:33:34.209436", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIBtkA9vdDPmcZhC0grI3Fceb0UTqFZy4"], "labels": [], "masters": [], "uuids": ["681b7fcf-8075-4a4e-8242-233f62044c57"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:33.066177", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:34.266 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:34.268 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:35.454 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6iTwaHzCeeVvT7LALKRlreepzxKm9BWeU'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.113979", "end": "2021-07-26 15:33:35.779566", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6iTwaHzCeeVvT7LALKRlreepzxKm9BWeU"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:34.665587", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:35.499 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:35 +0000 (0:00:06.864) 0:02:50.967 *********** 2021-07-26T15:33:35.518 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhW3P75Lcc1Us3BbZ6II6C5icynFUmoCNdb'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.118190", "end": "2021-07-26 15:33:35.482175", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhW3P75Lcc1Us3BbZ6II6C5icynFUmoCNdb"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:34.363985", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:35.519 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:35.594 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:35.887 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6u9GfTBDqx9qzstYT0sk3fplx3oz7fS3d'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.160240", "end": "2021-07-26 15:33:36.205691", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6u9GfTBDqx9qzstYT0sk3fplx3oz7fS3d"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:36.045451", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155305 s, 743 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155305 s, 743 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:35.888 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:35.900 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:36.193 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6jYc2DPcIcb2glRmdCpjNgCrR3jsa0WXx'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.169813", "end": "2021-07-26 15:33:36.520742", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6jYc2DPcIcb2glRmdCpjNgCrR3jsa0WXx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:36.350929", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164875 s, 700 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164875 s, 700 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:36.204 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QLQG', 'wwn-0x5000c50091e11660'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QLQG-part1', 'wwn-0x5000c50091e11660-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e11660', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QLQG', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QLQG", "wwn-0x5000c50091e11660"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QLQG-part1", "wwn-0x5000c50091e11660-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QLQG", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e11660"}}, 2021-07-26T15:33:36.206 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:33:36.383 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ceeGR3-Mlur-f41y-EHkH-DAV0-HlNE-Y0nz5y', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN', 'nvme-nvme.8086-50484654363230343030565a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057870", "end": "2021-07-26 15:33:36.710785", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ceeGR3-Mlur-f41y-EHkH-DAV0-HlNE-Y0nz5y", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN", "nvme-nvme.8086-50484654363230343030565a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:36.652915", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0530749 s, 2.2 GB/s", "std 2021-07-26T15:33:36.385 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0530749 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:36.394 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:36.395 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:36.690 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68G6lNbKIAJbWQ7cGiQeYyStY4pC9qGc0'], 'uuids': ['0d731a09-39bb-41bd-aa69-d3ca329183a2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.156305", "end": "2021-07-26 15:33:37.016917", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68G6lNbKIAJbWQ7cGiQeYyStY4pC9qGc0"], "labels": [], "masters": [], "uuids": ["0d731a09-39bb-41bd-aa69-d3ca329183a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:36.860612", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153181 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153181 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:36.702 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:36.714 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:36.768 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:33:36.770 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWydeLDw5zTXmzDjPSYXrfQdKdObMX0wbZ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.116901", "end": "2021-07-26 15:33:36.739437", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWydeLDw5zTXmzDjPSYXrfQdKdObMX0wbZ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:35.622536", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:33:36.805 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:36 +0000 (0:00:01.305) 0:02:52.273 *********** 2021-07-26T15:33:36.884 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:33:36.886 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.011 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68ytc4gDK41dZYvUy2rVBI1MWv4Lm6b4K'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.171634", "end": "2021-07-26 15:33:37.333418", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv68ytc4gDK41dZYvUy2rVBI1MWv4Lm6b4K"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:37.161784", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166976 s, 691 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166976 s, 691 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.022 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.138 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWvlGGvx39kKFgDNYS8tnKHUmc3vUk7VjE'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.116639", "end": "2021-07-26 15:33:37.107469", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWvlGGvx39kKFgDNYS8tnKHUmc3vUk7VjE"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:36.990830", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111813 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111813 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.150 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.162 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.300 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6iTwaHzCeeVvT7LALKRlreepzxKm9BWeU'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.159299", "end": "2021-07-26 15:33:37.630188", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-w8qpWVnjfCJOcTtzp5uYAzChlNiHCkv6iTwaHzCeeVvT7LALKRlreepzxKm9BWeU"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:37.470889", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154439 s, 747 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154439 s, 747 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.351 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:37 +0000 (0:00:00.546) 0:02:52.819 *********** 2021-07-26T15:33:37.405 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIq6ucQbLVLgnot9l38lOUpZxbPTxaUmX'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.114794", "end": "2021-07-26 15:33:37.378920", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIq6ucQbLVLgnot9l38lOUpZxbPTxaUmX"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:37.264126", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109988 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109988 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.418 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQDQ', 'wwn-0x5000c500871a8c35'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQDQ-part1', 'wwn-0x5000c500871a8c35-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a8c35', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQDQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQDQ", "wwn-0x5000c500871a8c35"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQDQ-part1", "wwn-0x5000c500871a8c35-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQDQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8c35"}}, 2021-07-26T15:33:37.420 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.601 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-sZLAQx-2kxW-9Ojc-ZdEO-FTNH-69zx-VgrKC9', 'nvme-INTEL_SSDPED1D480GA_PHMB75120091480DGN', 'nvme-nvme.8086-50484d42373531323030393134383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.052919", "end": "2021-07-26 15:33:37.569325", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-sZLAQx-2kxW-9Ojc-ZdEO-FTNH-69zx-VgrKC9", "nvme-INTEL_SSDPED1D480GA_PHMB75120091480DGN", "nvme-nvme.8086-50484d42373531323030393134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:37.516406", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0479282 s, 2.4 GB/s", "stderr_lines": [" 2021-07-26T15:33:37.603 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0479282 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.614 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.687 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:33:37.689 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.129711", "end": "2021-07-26 15:33:37.948475", "rc": 0, "start": "2021-07-26 15:33:37.818764", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.719 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:37 +0000 (0:00:00.368) 0:02:53.188 *********** 2021-07-26T15:33:37.856 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:33:37.857 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIBtkA9vdDPmcZhC0grI3Fceb0UTqFZy4'], 'uuids': ['681b7fcf-8075-4a4e-8242-233f62044c57']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.112685", "end": "2021-07-26 15:33:37.821239", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWIBtkA9vdDPmcZhC0grI3Fceb0UTqFZy4"], "labels": [], "masters": [], "uuids": ["681b7fcf-8075-4a4e-8242-233f62044c57"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:37.708554", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.107901 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.107901 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.871 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.873 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:37.960 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-07-26T15:33:37.961 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.091834", "end": "2021-07-26 15:33:38.285223", "rc": 0, "start": "2021-07-26 15:33:38.193389", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:37.992 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:37 +0000 (0:00:00.272) 0:02:53.460 *********** 2021-07-26T15:33:38.070 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:33:38.132 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.140) 0:02:53.601 *********** 2021-07-26T15:33:38.140 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhW3P75Lcc1Us3BbZ6II6C5icynFUmoCNdb'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.113097", "end": "2021-07-26 15:33:38.098873", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhW3P75Lcc1Us3BbZ6II6C5icynFUmoCNdb"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:37.985776", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.108292 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.108292 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:38.142 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.165 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.193 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.061) 0:02:53.662 *********** 2021-07-26T15:33:38.223 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.245 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.051) 0:02:53.713 *********** 2021-07-26T15:33:38.271 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:33:38.278 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.296 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.052) 0:02:53.765 *********** 2021-07-26T15:33:38.325 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.354 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.051) 0:02:53.816 *********** 2021-07-26T15:33:38.365 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:33:38.368 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWydeLDw5zTXmzDjPSYXrfQdKdObMX0wbZ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.111727", "end": "2021-07-26 15:33:38.342943", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rZtTcQlemWAnNGT1y26TlTHu2TlaqAhWydeLDw5zTXmzDjPSYXrfQdKdObMX0wbZ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:33:38.231216", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106861 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106861 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:38.407 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.058) 0:02:53.875 *********** 2021-07-26T15:33:38.481 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:33:38.506 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.099) 0:02:53.975 *********** 2021-07-26T15:33:38.545 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:33:38.547 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'block_used': 13859354, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235754, 'size_available': 926661648384, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235754, "block_size": 4096, "block_total": 240095108, "block_used": 13859354, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661648384, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.570 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.063) 0:02:54.038 *********** 2021-07-26T15:33:38.597 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-07-26T15:33:38.599 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.620 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.050) 0:02:54.089 *********** 2021-07-26T15:33:38.649 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:38.650 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.677 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.055) 0:02:54.145 *********** 2021-07-26T15:33:38.694 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:33:38.695 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.131911", "end": "2021-07-26 15:33:38.656470", "rc": 0, "start": "2021-07-26 15:33:38.524559", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:38.718 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.041) 0:02:54.186 *********** 2021-07-26T15:33:38.725 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:38.727 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.758 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.037) 0:02:54.224 *********** 2021-07-26T15:33:38.797 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.821 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.065) 0:02:54.289 *********** 2021-07-26T15:33:38.848 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.875 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.050) 0:02:54.340 *********** 2021-07-26T15:33:38.900 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:38.922 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.050) 0:02:54.390 *********** 2021-07-26T15:33:38.967 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.085663", "end": "2021-07-26 15:33:38.921312", "rc": 0, "start": "2021-07-26 15:33:38.835649", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:38.987 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:38 +0000 (0:00:00.065) 0:02:54.455 *********** 2021-07-26T15:33:39.016 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:33:39.041 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.053) 0:02:54.509 *********** 2021-07-26T15:33:39.068 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-07-26T15:33:39.070 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.093 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.052) 0:02:54.562 *********** 2021-07-26T15:33:39.121 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-07-26T15:33:39.122 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.145 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.051) 0:02:54.614 *********** 2021-07-26T15:33:39.175 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.201 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.055) 0:02:54.669 *********** 2021-07-26T15:33:39.229 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.254 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.052) 0:02:54.721 *********** 2021-07-26T15:33:39.386 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:33:39.413 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.160) 0:02:54.882 *********** 2021-07-26T15:33:39.451 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:33:39.453 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'block_used': 13859374, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235734, 'size_available': 926661566464, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150121, 'block_size': 4096, 'inode_available': 60904855}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235734, "block_size": 4096, "block_total": 240095108, "block_used": 13859374, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904855, "inode_total": 61054976, "inode_used": 150121, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661566464, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.475 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.061) 0:02:54.943 *********** 2021-07-26T15:33:39.503 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.529 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.050) 0:02:54.994 *********** 2021-07-26T15:33:39.552 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.050) 0:02:55.044 *********** 2021-07-26T15:33:39.602 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:39.604 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.625 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.049) 0:02:55.093 *********** 2021-07-26T15:33:39.652 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.676 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.050) 0:02:55.144 *********** 2021-07-26T15:33:39.714 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-07-26T15:33:39.716 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.743 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.061) 0:02:55.205 *********** 2021-07-26T15:33:39.764 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-07-26T15:33:39.766 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:39.789 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.052) 0:02:55.257 *********** 2021-07-26T15:33:39.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-07-26T15:33:39.852 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:33:39.877 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:39 +0000 (0:00:00.088) 0:02:55.345 *********** 2021-07-26T15:33:40.319 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:33:40.343 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:40 +0000 (0:00:00.466) 0:02:55.812 *********** 2021-07-26T15:33:40.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:40.801 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:41.001 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:41.194 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:41.363 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:41.586 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:41.786 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:41.958 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:42.141 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:42.168 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:42 +0000 (0:00:01.824) 0:02:57.636 *********** 2021-07-26T15:33:42.312 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:33:42.314 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:33:42.337 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:42 +0000 (0:00:00.168) 0:02:57.805 *********** 2021-07-26T15:33:42.355 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:33:42.356 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:33:42.382 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:42 +0000 (0:00:00.045) 0:02:57.851 *********** 2021-07-26T15:33:42.485 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:33:42.486 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.528 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:33:42.530 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:33:42.552 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:42 +0000 (0:00:00.169) 0:02:58.021 *********** 2021-07-26T15:33:42.634 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.709 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.753 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.839 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.883 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.896 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:42.922 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:42 +0000 (0:00:00.369) 0:02:58.390 *********** 2021-07-26T15:33:42.954 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-07-26T15:33:42.956 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:42.989 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:42 +0000 (0:00:00.067) 0:02:58.458 *********** 2021-07-26T15:33:43.020 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:33:43.022 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:43.046 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.056) 0:02:58.514 *********** 2021-07-26T15:33:43.085 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:33:43.087 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:33:43.097 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:43.130 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.084) 0:02:58.599 *********** 2021-07-26T15:33:43.160 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:43.186 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.053) 0:02:58.653 *********** 2021-07-26T15:33:43.202 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-07-26T15:33:43.205 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:33:43.227 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.043) 0:02:58.696 *********** 2021-07-26T15:33:43.236 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:33:43.238 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:43.263 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.035) 0:02:58.731 *********** 2021-07-26T15:33:43.272 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-07-26T15:33:43.274 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:33:43.311 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.048) 0:02:58.780 *********** 2021-07-26T15:33:43.413 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-07-26T15:33:43.415 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:33:43.445 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.132) 0:02:58.912 *********** 2021-07-26T15:33:43.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:33:43.506 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.062) 0:02:58.974 *********** 2021-07-26T15:33:43.812 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi018.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:33:43.857 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.351) 0:02:59.325 *********** 2021-07-26T15:33:43.886 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:33:43.910 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:43 +0000 (0:00:00.053) 0:02:59.379 *********** 2021-07-26T15:33:44.375 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:33:44.377 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:33:44.401 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.487) 0:02:59.867 *********** 2021-07-26T15:33:44.426 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.027) 0:02:59.895 *********** 2021-07-26T15:33:44.435 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.458 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.031) 0:02:59.926 *********** 2021-07-26T15:33:44.465 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.490 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.031) 0:02:59.958 *********** 2021-07-26T15:33:44.496 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.522 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.030) 0:02:59.989 *********** 2021-07-26T15:33:44.527 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.552 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.031) 0:03:00.020 *********** 2021-07-26T15:33:44.558 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:33:44.560 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.584 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.031) 0:03:00.052 *********** 2021-07-26T15:33:44.591 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.620 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.034) 0:03:00.086 *********** 2021-07-26T15:33:44.625 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:33:44.627 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.651 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.033) 0:03:00.119 *********** 2021-07-26T15:33:44.659 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:44.685 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.033) 0:03:00.153 *********** 2021-07-26T15:33:44.807 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:33:44.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.150) 0:03:00.304 *********** 2021-07-26T15:33:44.855 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:33:44.887 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:44 +0000 (0:00:00.051) 0:03:00.355 *********** 2021-07-26T15:33:44.988 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-07-26T15:33:44.990 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:33:45.014 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:45 +0000 (0:00:00.127) 0:03:00.483 *********** 2021-07-26T15:33:45.053 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:33:45.085 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:45 +0000 (0:00:00.070) 0:03:00.553 *********** 2021-07-26T15:33:45.386 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-07-26T15:33:45.388 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:33:45.413 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:45 +0000 (0:00:00.326) 0:03:00.879 *********** 2021-07-26T15:33:45.450 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:33:45.479 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:45 +0000 (0:00:00.065) 0:03:00.945 *********** 2021-07-26T15:33:45.762 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-07-26T15:33:45.764 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:33:45.788 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:45 +0000 (0:00:00.310) 0:03:01.256 *********** 2021-07-26T15:33:45.827 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:33:45.853 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:45 +0000 (0:00:00.065) 0:03:01.321 *********** 2021-07-26T15:33:46.482 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-07-26T15:33:46.484 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:33:46.519 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.663) 0:03:01.985 *********** 2021-07-26T15:33:46.537 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:33:46.565 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.047) 0:03:02.033 *********** 2021-07-26T15:33:46.785 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-07-26T15:33:46.786 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.118317", "end": "2021-07-26 15:33:46.754934", "rc": 0, "start": "2021-07-26 15:33:46.636617", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:33:46.811 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.246) 0:03:02.280 *********** 2021-07-26T15:33:46.834 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.117624", "end": "2021-07-26 15:33:47.156730", "rc": 0, "start": "2021-07-26 15:33:47.039106", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:33:46.863 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.051) 0:03:02.331 *********** 2021-07-26T15:33:46.872 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:46.897 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.034) 0:03:02.366 *********** 2021-07-26T15:33:46.904 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:46.930 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.031) 0:03:02.398 *********** 2021-07-26T15:33:46.932 INFO:teuthology.task.ansible.out: 2021-07-26T15:33:46.939 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:46.972 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:46 +0000 (0:00:00.041) 0:03:02.440 *********** 2021-07-26T15:33:46.979 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:47.005 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:47 +0000 (0:00:00.033) 0:03:02.473 *********** 2021-07-26T15:33:47.645 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:33:47.668 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:47 +0000 (0:00:00.662) 0:03:03.136 *********** 2021-07-26T15:33:47.675 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:33:47.701 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:47 +0000 (0:00:00.032) 0:03:03.168 *********** 2021-07-26T15:33:47.706 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-07-26T15:33:47.708 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:47.731 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:47 +0000 (0:00:00.030) 0:03:03.199 *********** 2021-07-26T15:33:47.738 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:47.773 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:47 +0000 (0:00:00.042) 0:03:03.242 *********** 2021-07-26T15:33:48.101 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-07-26T15:33:48.102 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:33:48.142 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.366) 0:03:03.608 *********** 2021-07-26T15:33:48.153 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:33:48.177 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.036) 0:03:03.645 *********** 2021-07-26T15:33:48.186 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:48.213 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.035) 0:03:03.681 *********** 2021-07-26T15:33:48.221 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:48.247 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.034) 0:03:03.715 *********** 2021-07-26T15:33:48.432 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-07-26T15:33:48.433 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:29:18 UTC", "ActiveEnterTimestampMonotonic": "15765651", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target -.mount sysinit.target network.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:29:18 UTC", "AssertTimestampMonotonic": "15567525", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:29:18 UTC", "ConditionTimestampMonotonic": "15567524", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-07-26T15:33:48.435 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "826", "ExecMainStartTimestamp": "Mon 2021-07-26 15:29:18 UTC", "ExecMainStartTimestampMonotonic": "15765638", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:29:18 UTC", "InactiveExitTimestampMonotonic": "15568665", "InvocationID": "37f48d9bd075485eaf2e0e9f17110697", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:33:48.437 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127802", "LimitNPROCSoft": "127802", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "826", "MemoryAccounting": "yes", "MemoryCurrent": "3624960", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-07-26T15:33:48.438 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:29:18 UTC", "StateChangeTimestampMonotonic": "15765651", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38340", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:33:48.460 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.212) 0:03:03.928 *********** 2021-07-26T15:33:48.470 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:30:32 UTC", "ActiveEnterTimestampMonotonic": "13412368", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service network.target -.mount basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:30:32 UTC", "AssertTimestampMonotonic": "13307836", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:30:32 UTC", "ConditionTimestampMonotonic": "13307836", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-07-26T15:33:48.473 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "825", "ExecMainStartTimestamp": "Mon 2021-07-26 15:30:32 UTC", "ExecMainStartTimestampMonotonic": "13412354", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:30:32 UTC", "InactiveExitTimestampMonotonic": "13308696", "InvocationID": "851435c8ed6440c28be9b8fb3cba03cb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:33:48.475 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "825", "MemoryAccounting": "yes", "MemoryCurrent": "3387392", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-07-26T15:33:48.477 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:30:32 UTC", "StateChangeTimestampMonotonic": "13412368", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:33:48.494 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.034) 0:03:03.962 *********** 2021-07-26T15:33:48.500 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:48.502 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:33:48.524 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.030) 0:03:03.993 *********** 2021-07-26T15:33:48.531 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:33:48.558 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.033) 0:03:04.026 *********** 2021-07-26T15:33:48.567 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:33:48.569 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:33:48.594 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.035) 0:03:04.062 *********** 2021-07-26T15:33:48.603 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:33:48.628 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.034) 0:03:04.097 *********** 2021-07-26T15:33:48.636 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-07-26T15:33:48.637 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:48.664 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.035) 0:03:04.132 *********** 2021-07-26T15:33:48.672 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:48.701 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:48 +0000 (0:00:00.037) 0:03:04.169 *********** 2021-07-26T15:33:49.771 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-07-26T15:33:49.773 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:33:49.796 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:49 +0000 (0:00:01.094) 0:03:05.264 *********** 2021-07-26T15:33:49.823 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-07-26T15:33:49.825 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:49.847 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:49 +0000 (0:00:00.050) 0:03:05.315 *********** 2021-07-26T15:33:49.854 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-07-26T15:33:49.855 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:33:49.879 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:49 +0000 (0:00:00.032) 0:03:05.348 *********** 2021-07-26T15:33:49.907 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-07-26T15:33:49.909 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:49.931 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:49 +0000 (0:00:00.051) 0:03:05.399 *********** 2021-07-26T15:33:50.021 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-07-26T15:33:50.023 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:33:50.048 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:50 +0000 (0:00:00.117) 0:03:05.517 *********** 2021-07-26T15:33:50.109 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:33:50.134 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:50 +0000 (0:00:00.085) 0:03:05.603 *********** 2021-07-26T15:33:50.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-07-26T15:33:50.489 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:33:50.517 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:50 +0000 (0:00:00.382) 0:03:05.985 *********** 2021-07-26T15:33:50.589 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:33:50.621 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:50 +0000 (0:00:00.100) 0:03:06.086 *********** 2021-07-26T15:33:52.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:33:52.863 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:52 +0000 (0:00:02.245) 0:03:08.332 *********** 2021-07-26T15:33:52.891 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:33:52.917 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:52 +0000 (0:00:00.053) 0:03:08.385 *********** 2021-07-26T15:33:53.382 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-07-26T15:33:53.384 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:33:53.411 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:53 +0000 (0:00:00.494) 0:03:08.879 *********** 2021-07-26T15:33:53.430 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:33:53.459 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:53 +0000 (0:00:00.044) 0:03:08.923 *********** 2021-07-26T15:33:53.463 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-07-26T15:33:53.464 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-07-26T15:33:53.489 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:53 +0000 (0:00:00.034) 0:03:08.958 *********** 2021-07-26T15:33:53.497 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-07-26T15:33:53.523 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:53 +0000 (0:00:00.033) 0:03:08.991 *********** 2021-07-26T15:33:53.678 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-07-26T15:33:53.680 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313126.7694526, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313126.7654526, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313126.7654526, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:33:53.704 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:53 +0000 (0:00:00.180) 0:03:09.172 *********** 2021-07-26T15:33:53.722 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313057.7963505, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313057.7923505, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313057.7923505, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:33:53.746 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:53 +0000 (0:00:00.042) 0:03:09.215 *********** 2021-07-26T15:33:54.188 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:33:54.190 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:33:54.213 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.466) 0:03:09.682 *********** 2021-07-26T15:33:54.238 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.024) 0:03:09.706 *********** 2021-07-26T15:33:54.255 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-07-26T15:33:54.257 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:33:54.279 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.040) 0:03:09.747 *********** 2021-07-26T15:33:54.287 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:33:54.312 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.032) 0:03:09.780 *********** 2021-07-26T15:33:54.318 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-07-26T15:33:54.321 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.343 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.031) 0:03:09.812 *********** 2021-07-26T15:33:54.351 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.377 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.033) 0:03:09.845 *********** 2021-07-26T15:33:54.522 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-07-26T15:33:54.524 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:33:54.553 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.175) 0:03:10.021 *********** 2021-07-26T15:33:54.560 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:33:54.587 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.034) 0:03:10.056 *********** 2021-07-26T15:33:54.730 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-07-26T15:33:54.732 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:33:54.756 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.169) 0:03:10.225 *********** 2021-07-26T15:33:54.764 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:33:54.791 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.035) 0:03:10.260 *********** 2021-07-26T15:33:54.799 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-07-26T15:33:54.801 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.825 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.032) 0:03:10.293 *********** 2021-07-26T15:33:54.832 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.035) 0:03:10.329 *********** 2021-07-26T15:33:54.868 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-07-26T15:33:54.869 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.880 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.882 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.916 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.047) 0:03:10.376 *********** 2021-07-26T15:33:54.919 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi111.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.944 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.036) 0:03:10.412 *********** 2021-07-26T15:33:54.957 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.969 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.971 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi018.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:54.998 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:54 +0000 (0:00:00.053) 0:03:10.466 *********** 2021-07-26T15:33:55.006 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.007 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.008 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.009 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.009 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.037 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.039) 0:03:10.505 *********** 2021-07-26T15:33:55.045 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.070 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.033) 0:03:10.539 *********** 2021-07-26T15:33:55.078 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.108 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.037) 0:03:10.576 *********** 2021-07-26T15:33:55.115 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-07-26T15:33:55.116 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.147 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.037) 0:03:10.614 *********** 2021-07-26T15:33:55.155 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.181 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.034) 0:03:10.648 *********** 2021-07-26T15:33:55.187 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.215 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.035) 0:03:10.684 *********** 2021-07-26T15:33:55.223 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.252 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.035) 0:03:10.719 *********** 2021-07-26T15:33:55.259 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-07-26T15:33:55.260 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.285 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.034) 0:03:10.754 *********** 2021-07-26T15:33:55.294 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.322 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.035) 0:03:10.789 *********** 2021-07-26T15:33:55.327 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-07-26T15:33:55.329 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.363 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.042) 0:03:10.831 *********** 2021-07-26T15:33:55.374 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.408 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.045) 0:03:10.876 *********** 2021-07-26T15:33:55.416 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.452 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.042) 0:03:10.919 *********** 2021-07-26T15:33:55.462 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.489 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.038) 0:03:10.957 *********** 2021-07-26T15:33:55.498 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.524 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.035) 0:03:10.992 *********** 2021-07-26T15:33:55.532 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.561 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.037) 0:03:11.029 *********** 2021-07-26T15:33:55.568 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:33:55.570 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.606 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.044) 0:03:11.074 *********** 2021-07-26T15:33:55.614 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:55.795 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:55 +0000 (0:00:00.189) 0:03:11.264 *********** 2021-07-26T15:33:55.952 INFO:teuthology.task.ansible.out: 2021-07-26T15:33:55.955 INFO:teuthology.task.ansible.out:TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:33:55.958 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010566", "end": "2021-07-26 15:33:55.781330", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:33:55.770764", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.011 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010498", "end": "2021-07-26 15:33:55.969546", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:33:55.959048", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.127 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006134", "end": "2021-07-26 15:33:56.094452", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:33:56.088318", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.171 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005783", "end": "2021-07-26 15:33:56.136243", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:33:56.130460", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.278 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005256", "end": "2021-07-26 15:33:56.252249", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:33:56.246993", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.331 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005561", "end": "2021-07-26 15:33:56.290237", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:33:56.284676", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.457 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.020836", "end": "2021-07-26 15:33:56.423742", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:33:56.402906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.497 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:56 +0000 (0:00:00.692) 0:03:11.956 *********** 2021-07-26T15:33:56.515 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-07-26T15:33:56.518 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi111.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.036630", "end": "2021-07-26 15:33:56.480665", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:33:56.444035", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:56.561 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:56 +0000 (0:00:00.070) 0:03:12.027 *********** 2021-07-26T15:33:56.596 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:56 +0000 (0:00:00.033) 0:03:12.060 *********** 2021-07-26T15:33:56.600 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:56.626 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-07-26T15:33:56.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:56 +0000 (0:00:00.066) 0:03:12.127 *********** 2021-07-26T15:33:56.698 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:56.764 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-07-26T15:33:56.787 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:56 +0000 (0:00:00.127) 0:03:12.255 *********** 2021-07-26T15:33:56.811 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:56 +0000 (0:00:00.024) 0:03:12.279 *********** 2021-07-26T15:33:57.827 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi018.front.sepia.ceph.com] 2021-07-26T15:33:57.877 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:57 +0000 (0:00:01.066) 0:03:13.345 *********** 2021-07-26T15:33:57.905 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:33:57.906 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:33:57.929 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:57 +0000 (0:00:00.051) 0:03:13.397 *********** 2021-07-26T15:33:57.956 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:33:57.958 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:57.988 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:57 +0000 (0:00:00.057) 0:03:13.455 *********** 2021-07-26T15:33:58.024 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-07-26T15:33:58.026 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:33:58.048 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:58 +0000 (0:00:00.061) 0:03:13.517 *********** 2021-07-26T15:33:58.772 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi111.front.sepia.ceph.com] 2021-07-26T15:33:58.825 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:58 +0000 (0:00:00.776) 0:03:14.293 *********** 2021-07-26T15:33:58.853 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:33:58.855 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:33:58.877 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:58 +0000 (0:00:00.052) 0:03:14.346 *********** 2021-07-26T15:33:58.904 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:33:58.906 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:33:58.930 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:58 +0000 (0:00:00.052) 0:03:14.399 *********** 2021-07-26T15:33:58.968 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi111.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:33:58.992 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:58 +0000 (0:00:00.061) 0:03:14.460 *********** 2021-07-26T15:34:14.401 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.9 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " auf 2021-07-26T15:34:14.403 INFO:teuthology.task.ansible.out:s-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.9 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:34:14.426 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:15.434) 0:03:29.895 *********** 2021-07-26T15:34:14.456 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:34:14.458 INFO:teuthology.task.ansible.out:skipping: [smithi018.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:34:14.481 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:00.054) 0:03:29.949 *********** 2021-07-26T15:34:14.510 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:34:14.512 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:34:14.535 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:00.054) 0:03:30.003 *********** 2021-07-26T15:34:14.741 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-07-26T15:34:14.743 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:34:14.839 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-07-26T15:34:14.841 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (19.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-07-26T15:34:14.843 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (19.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:34:14.864 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:00.328) 0:03:30.332 *********** 2021-07-26T15:34:14.891 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:34:14.893 INFO:teuthology.task.ansible.out:skipping: [smithi111.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:34:14.914 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:00.050) 0:03:30.383 *********** 2021-07-26T15:34:14.921 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-07-26T15:34:14.923 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:34:14.962 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:00.047) 0:03:30.430 *********** 2021-07-26T15:34:14.970 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:34:14.972 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:34:14.999 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:14 +0000 (0:00:00.036) 0:03:30.467 *********** 2021-07-26T15:34:15.198 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi111.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:34:15.356 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:34:15.383 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:15 +0000 (0:00:00.383) 0:03:30.850 *********** 2021-07-26T15:34:15.452 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi018.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313655.0306878-4248-39597033554480/source", "state": "file", "uid": 0} 2021-07-26T15:34:15.881 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313655.4762235-4248-188762054709895/source", "state": "file", "uid": 0} 2021-07-26T15:34:15.905 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:15 +0000 (0:00:00.523) 0:03:31.374 *********** 2021-07-26T15:34:15.913 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313655.4450862-4288-101787998816424/source", "state": "file", "uid": 0} 2021-07-26T15:34:16.330 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313655.9207397-4288-172624240499974/source", "state": "file", "uid": 0} 2021-07-26T15:34:16.356 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:16 +0000 (0:00:00.450) 0:03:31.824 *********** 2021-07-26T15:34:16.690 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-07-26T15:34:16.691 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] => {"cache_update_time": 1627313267, "cache_updated": false, "changed": false} 2021-07-26T15:34:16.716 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:16 +0000 (0:00:00.358) 0:03:32.183 *********** 2021-07-26T15:34:17.109 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"cache_update_time": 1627313274, "cache_updated": false, "changed": false} 2021-07-26T15:34:17.134 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:17 +0000 (0:00:00.418) 0:03:32.602 *********** 2021-07-26T15:34:21.283 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:34:21.285 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-c8tlfgn9\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-c8tlfgn9"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-c8tlfgn9\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=76515f287143a26fb805d4b1ee69a425daa1fa90681951609d56f5e0ca221c0e\n Stored in directory: /tmp/pip-ephem-wheel-cache-4uomqock/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=63ac2631100dba118323a9072b9de536f078a92d6a7073b674514f36ae768e89\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:34:21.287 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-c8tlfgn9", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=76515f287143a26fb805d4b1ee69a425daa1fa90681951609d56f5e0ca221c0e", " Stored in directory: /tmp/pip-ephem-wheel-cache-4uomqock/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=63ac2631100dba118323a9072b9de536f078a92d6a7073b674514f36ae768e89", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:34:21.308 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:21 +0000 (0:00:04.174) 0:03:36.777 *********** 2021-07-26T15:34:21.493 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi018.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:34:21.519 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:21 +0000 (0:00:00.210) 0:03:36.987 *********** 2021-07-26T15:34:21.621 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:34:21.623 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-_5vqnj4r\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-_5vqnj4r"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-_5vqnj4r\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=76515f287143a26fb805d4b1ee69a425daa1fa90681951609d56f5e0ca221c0e\n Stored in directory: /tmp/pip-ephem-wheel-cache-0kjuos3r/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=63ac2631100dba118323a9072b9de536f078a92d6a7073b674514f36ae768e89\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:34:21.624 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-_5vqnj4r", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=76515f287143a26fb805d4b1ee69a425daa1fa90681951609d56f5e0ca221c0e", " Stored in directory: /tmp/pip-ephem-wheel-cache-0kjuos3r/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=63ac2631100dba118323a9072b9de536f078a92d6a7073b674514f36ae768e89", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:34:21.648 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:21 +0000 (0:00:00.128) 0:03:37.116 *********** 2021-07-26T15:34:21.820 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-07-26T15:34:21.822 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:34:21.845 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:21 +0000 (0:00:00.197) 0:03:37.314 *********** 2021-07-26T15:34:21.957 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-07-26T15:34:21.959 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313661.5698283-4954-10632966414722/source", "state": "file", "uid": 0} 2021-07-26T15:34:21.983 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:21 +0000 (0:00:00.137) 0:03:37.452 *********** 2021-07-26T15:34:22.205 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:34:22.207 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.038430", "end": "2021-07-26 15:34:22.180807", "rc": 0, "start": "2021-07-26 15:34:22.142377", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:34:22.229 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:22 +0000 (0:00:00.246) 0:03:37.698 *********** 2021-07-26T15:34:22.268 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313661.897741-5006-23550825689269/source", "state": "file", "uid": 0} 2021-07-26T15:34:22.294 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:22 +0000 (0:00:00.063) 0:03:37.762 *********** 2021-07-26T15:34:22.519 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:34:22.521 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.036422", "end": "2021-07-26 15:34:22.487812", "rc": 0, "start": "2021-07-26 15:34:22.451390", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:34:22.544 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:22 +0000 (0:00:00.250) 0:03:38.012 *********** 2021-07-26T15:34:23.894 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-07-26T15:34:23.896 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:34:09 UTC", "ActiveEnterTimestampMonotonic": "306829234", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target docker.socket basic.target system.slice systemd-journald.socket firewalld.service containerd.service network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:34:07 UTC", "AssertTimestampMonotonic": "304932529", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:34:07 UTC", "ConditionTimestampMonotonic": "304932529", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:34:23.897 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8754", "ExecMainStartTimestamp": "Mon 2021-07-26 15:34:07 UTC", "ExecMainStartTimestampMonotonic": "304933377", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:34:07 UTC] ; stop_time=[n/a] ; pid=8754 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:34:07 UTC] ; stop_time=[n/a] ; pid=8754 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:34:23.899 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:34:07 UTC", "InactiveExitTimestampMonotonic": "304933651", "InvocationID": "2c1b17bb8dac4b12977f9d5205d13a91", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8754", "MemoryAccounting": "yes", "MemoryCurrent": "54755328", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:34:23.901 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:34:09 UTC", "StateChangeTimestampMonotonic": "306829234", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:34:23.902 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:34:24.245 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:34:10 UTC", "ActiveEnterTimestampMonotonic": "231516848", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "docker.socket system.slice systemd-journald.socket network-online.target containerd.service firewalld.service basic.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:34:08 UTC", "AssertTimestampMonotonic": "229642661", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:34:08 UTC", "ConditionTimestampMonotonic": "229642660", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:34:24.247 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8836", "ExecMainStartTimestamp": "Mon 2021-07-26 15:34:08 UTC", "ExecMainStartTimestampMonotonic": "229643535", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:34:08 UTC] ; stop_time=[n/a] ; pid=8836 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:34:08 UTC] ; stop_time=[n/a] ; pid=8836 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:34:24.249 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:34:08 UTC", "InactiveExitTimestampMonotonic": "229644086", "InvocationID": "5bde5afa4359467ca3b07bb181aca75f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8836", "MemoryAccounting": "yes", "MemoryCurrent": "53768192", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:34:24.250 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:34:10 UTC", "StateChangeTimestampMonotonic": "231516848", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:34:24.252 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:34:24.319 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY [testnodes] *************************************************************** 2021-07-26T15:34:24.335 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Monday 26 July 2021 15:34:24 +0000 (0:00:01.791) 0:03:39.804 *********** 2021-07-26T15:34:25.330 INFO:teuthology.task.ansible.out:ok: [smithi018.front.sepia.ceph.com] 2021-07-26T15:34:25.361 INFO:teuthology.task.ansible.out:ok: [smithi111.front.sepia.ceph.com] 2021-07-26T15:34:25.381 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-07-26T15:34:25.383 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:34:25 +0000 (0:00:01.045) 0:03:40.850 *********** 2021-07-26T15:34:25.567 INFO:teuthology.task.ansible.out:changed: [smithi018.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:34:25.588 INFO:teuthology.task.ansible.out:changed: [smithi111.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:34:25.591 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-07-26T15:34:25.592 INFO:teuthology.task.ansible.out:smithi018.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 smithi111.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 Monday 26 July 2021 15:34:25 +0000 (0:00:00.209) 0:03:41.060 *********** =============================================================================== Create all admin users with sudo access. ------------------------------- 27.54s testnode : Upgrade packages -------------------------------------------- 24.17s users : Update authorized_keys using the keys repo --------------------- 20.02s container-host : Install container packages ---------------------------- 15.44s testnode : Install packages -------------------------------------------- 13.05s testnode : Ensure packages are not present. ---------------------------- 11.41s testnode : Zap all non-root disks --------------------------------------- 6.87s Remove revoked users ---------------------------------------------------- 6.63s container-host : Install registries-conf-ctl ---------------------------- 4.17s common : Update apt cache ----------------------------------------------- 3.87s Gathering Facts --------------------------------------------------------- 2.33s testnode : Install apt keys --------------------------------------------- 2.26s testnode : Install packages via pip ------------------------------------- 2.25s testnode : Update apt cache. -------------------------------------------- 2.23s testnode : Create logical volume(s) ------------------------------------- 1.82s container-host : Restart docker service --------------------------------- 1.79s testnode : Install python-pip on apt based systems. --------------------- 1.09s users : Update authorized_keys for each user with literal keys ---------- 1.09s Gathering Facts --------------------------------------------------------- 1.07s Gathering Facts --------------------------------- 2021-07-26T15:34:25.594 INFO:teuthology.task.ansible.out:------------------------ 1.05s 2021-07-26T15:34:25.997 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com')] 2021-07-26T15:34:25.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:34:26.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:34:26.061 DEBUG:teuthology.orchestra.run.smithi018:> true 2021-07-26T15:34:26.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:34:26.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:34:26.235 DEBUG:teuthology.orchestra.run.smithi111:> true 2021-07-26T15:34:26.360 INFO:teuthology.run_tasks:Running task clock... 2021-07-26T15:34:26.374 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-07-26T15:34:26.375 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:34:26.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:34:26.412 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:34:26.412 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Command line: ntpd -gq 2021-07-26T15:34:26.413 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: proto: precision = 0.069 usec (-24) 2021-07-26T15:34:26.413 INFO:teuthology.orchestra.run.smithi018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:34:26.414 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:34:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:34:26.416 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:34:26.416 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:34:26.417 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:34:26.417 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:34:26.417 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listen normally on 3 ens1f0 172.21.15.18:123 2021-07-26T15:34:26.417 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listen normally on 4 lo [::1]:123 2021-07-26T15:34:26.418 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1362%4]:123 2021-07-26T15:34:26.418 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:26 ntpd[10128]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:34:27.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:27.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:27.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:27.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:27.419 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:27.419 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:27.419 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:27.420 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:27.420 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:27.421 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:27.421 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:27 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:28.413 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:28 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:28.413 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:28 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:28.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:28 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:28.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:28 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:28.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:28 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:28.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:28 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:29.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:29.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:29.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:29.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:29.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:29.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:29.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:29.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:29.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:29 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:30.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:30 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:30.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:30 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:30.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:30 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:30.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:30 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:30.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:30 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:30.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:30 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:31.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:31.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:31 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:32 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:32 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:32 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:32 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:32 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:32 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:33.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:33.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:33.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:33.414 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:33.416 INFO:teuthology.orchestra.run.smithi018.stdout:26 Jul 15:34:33 ntpd[10128]: ntpd: time slew -0.000114 s 2021-07-26T15:34:33.416 INFO:teuthology.orchestra.run.smithi018.stdout:ntpd: time slew -0.000114s 2021-07-26T15:34:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:26 Jul 15:34:33 ntpd[10128]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:34:33.478 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:34:33.478 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2021-07-26T15:34:33.478 INFO:teuthology.orchestra.run.smithi018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:33.479 INFO:teuthology.orchestra.run.smithi018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:33.479 INFO:teuthology.orchestra.run.smithi018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:33.479 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:33.480 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:34:33.481 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:34:33.514 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:34:33.515 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Command line: ntpd -gq 2021-07-26T15:34:33.515 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: proto: precision = 0.215 usec (-22) 2021-07-26T15:34:33.516 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:34:33.516 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:34:33.517 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:34:33.518 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:34:33.518 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:34:33.519 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:34:33.519 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:34:33.519 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2021-07-26T15:34:33.519 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listen normally on 4 lo [::1]:123 2021-07-26T15:34:33.520 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2021-07-26T15:34:33.520 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:33 ntpd[10214]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:34:34.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:34 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:34.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:34 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:34.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:34 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:34.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:34 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:34.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:34 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:34.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:34 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:35.515 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:35 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:35.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:35 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:35.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:35 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:35.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:35 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:35.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:35 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:35.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:35 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:36.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:36.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:36.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:36.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:36.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:36.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:36.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:36.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:36.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:36.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:36.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:36.519 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:36 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:37.515 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:37 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:37.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:37 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:37.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:37 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:37.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:37 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:37.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:37 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:37.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:37 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:38.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:38.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:38.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:38.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:38.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:38.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:38.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:38.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:38.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:38.519 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:38.519 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:38.519 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:38.519 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:38.520 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:38.520 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:38.520 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:38.520 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:38.520 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:38 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:39.515 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:39 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:39.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:39 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:39.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:39 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:39.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:39 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:39.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:39 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:39.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:39 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:40.516 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:40.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:40.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:40.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:40.517 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:40.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:40.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:34:40.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:34:40.518 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:34:40.519 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:34:40.519 INFO:teuthology.orchestra.run.smithi111.stdout:26 Jul 15:34:40 ntpd[10214]: ntpd: time slew +0.003291 s 2021-07-26T15:34:40.520 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew +0.003291s 2021-07-26T15:34:40.520 INFO:teuthology.orchestra.run.smithi111.stderr:26 Jul 15:34:40 ntpd[10214]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:34:40.581 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:34:40.581 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2021-07-26T15:34:40.582 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:40.582 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:40.582 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:40.582 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:34:40.584 INFO:teuthology.run_tasks:Running task install... 2021-07-26T15:34:40.593 DEBUG:teuthology.task.install:project ceph 2021-07-26T15:34:40.593 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}} 2021-07-26T15:34:40.593 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:34:40.594 INFO:teuthology.task.install:Using flavor: basic 2021-07-26T15:34:40.601 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:34:40.601 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:34:40.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:34:40.654 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:34:40.659 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:34:40.660 DEBUG:teuthology.orchestra.run.smithi111:> sudo lsb_release -is 2021-07-26T15:34:40.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2021-07-26T15:34:40.711 INFO:teuthology.orchestra.run.smithi111.stdout:Ubuntu 2021-07-26T15:34:40.716 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:34:40.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2021-07-26T15:34:40.755 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:34:40.815 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:34:40.815 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:34:40.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:34:40.818 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:34:40.863 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:34:40.868 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:34:40.868 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:34:40.869 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:34:40.869 INFO:teuthology.packaging:ref: None 2021-07-26T15:34:40.869 INFO:teuthology.packaging:tag: None 2021-07-26T15:34:40.870 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:34:40.870 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:34:40.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:34:40.879 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:34:40.879 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:34:40.881 DEBUG:teuthology.orchestra.run.smithi111:> sudo lsb_release -is 2021-07-26T15:34:40.930 INFO:teuthology.orchestra.run.smithi111.stdout:Ubuntu 2021-07-26T15:34:40.934 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:34:40.934 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:34:40.934 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:34:40.935 INFO:teuthology.packaging:ref: None 2021-07-26T15:34:40.935 INFO:teuthology.packaging:tag: None 2021-07-26T15:34:40.935 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:34:40.936 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:34:40.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:34:41.127 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default/ 2021-07-26T15:34:41.128 INFO:teuthology.task.install.deb:Package version is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:34:41.163 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default/ 2021-07-26T15:34:41.164 INFO:teuthology.task.install.deb:Package version is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:34:41.268 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:34:41.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:34:41.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2021-07-26T15:34:41.289 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:34:41.289 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:34:41.306 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2021-07-26T15:34:41.424 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:34:41.442 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:34:41.486 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:34:41.505 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:34:41.510 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:34:41.529 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:34:41.536 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:34:41.542 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:34:41.554 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:34:41.558 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-07-26T15:34:41.559 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:34:41.578 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 Packages [17.1 kB] 2021-07-26T15:34:41.599 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 Packages [17.1 kB] 2021-07-26T15:34:41.624 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:34:41.634 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-07-26T15:34:41.642 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:34:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:34:41.727 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:34:42.149 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 128 kB in 1s (185 kB/s) 2021-07-26T15:34:42.165 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 128 kB in 1s (182 kB/s) 2021-07-26T15:34:42.929 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:34:42.939 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:34:42.951 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.5-102-gc6a1fa5a-1focal cephadm=16.2.5-102-gc6a1fa5a-1focal ceph-mds=16.2.5-102-gc6a1fa5a-1focal ceph-mgr=16.2.5-102-gc6a1fa5a-1focal ceph-common=16.2.5-102-gc6a1fa5a-1focal ceph-fuse=16.2.5-102-gc6a1fa5a-1focal ceph-test=16.2.5-102-gc6a1fa5a-1focal radosgw=16.2.5-102-gc6a1fa5a-1focal python3-rados=16.2.5-102-gc6a1fa5a-1focal python3-rgw=16.2.5-102-gc6a1fa5a-1focal python3-cephfs=16.2.5-102-gc6a1fa5a-1focal python3-rbd=16.2.5-102-gc6a1fa5a-1focal libcephfs2=16.2.5-102-gc6a1fa5a-1focal libcephfs-dev=16.2.5-102-gc6a1fa5a-1focal librados2=16.2.5-102-gc6a1fa5a-1focal librbd1=16.2.5-102-gc6a1fa5a-1focal rbd-fuse=16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:34:42.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.5-102-gc6a1fa5a-1focal cephadm=16.2.5-102-gc6a1fa5a-1focal ceph-mds=16.2.5-102-gc6a1fa5a-1focal ceph-mgr=16.2.5-102-gc6a1fa5a-1focal ceph-common=16.2.5-102-gc6a1fa5a-1focal ceph-fuse=16.2.5-102-gc6a1fa5a-1focal ceph-test=16.2.5-102-gc6a1fa5a-1focal radosgw=16.2.5-102-gc6a1fa5a-1focal python3-rados=16.2.5-102-gc6a1fa5a-1focal python3-rgw=16.2.5-102-gc6a1fa5a-1focal python3-cephfs=16.2.5-102-gc6a1fa5a-1focal python3-rbd=16.2.5-102-gc6a1fa5a-1focal libcephfs2=16.2.5-102-gc6a1fa5a-1focal libcephfs-dev=16.2.5-102-gc6a1fa5a-1focal librados2=16.2.5-102-gc6a1fa5a-1focal librbd1=16.2.5-102-gc6a1fa5a-1focal rbd-fuse=16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:34:43.020 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2021-07-26T15:34:43.025 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:34:43.183 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2021-07-26T15:34:43.184 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2021-07-26T15:34:43.188 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2021-07-26T15:34:43.189 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2021-07-26T15:34:43.325 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:34:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:34:43.327 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:34:43.327 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2021-07-26T15:34:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-07-26T15:34:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2021-07-26T15:34:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-07-26T15:34:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:34:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:34:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:34:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:34:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2021-07-26T15:34:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-07-26T15:34:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:34:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:34:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:34:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:34:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:34:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:34:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:34:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:34:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:34:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:34:43.333 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2021-07-26T15:34:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:34:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:34:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:34:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:34:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:34:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:34:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:34:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:34:43.336 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2021-07-26T15:34:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2021-07-26T15:34:43.337 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:34:43.338 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:34:43.338 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:34:43.339 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2021-07-26T15:34:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-07-26T15:34:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2021-07-26T15:34:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-07-26T15:34:43.339 INFO:teuthology.orchestra.run.smithi018.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:34:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:34:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:34:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:34:43.340 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2021-07-26T15:34:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-07-26T15:34:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:34:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:34:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:34:43.341 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:34:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:34:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:34:43.343 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:34:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:34:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:34:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:34:43.344 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2021-07-26T15:34:43.344 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:34:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:34:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:34:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:34:43.345 INFO:teuthology.orchestra.run.smithi018.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:34:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:34:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:34:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:34:43.346 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2021-07-26T15:34:43.346 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2021-07-26T15:34:43.420 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2021-07-26T15:34:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:34:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-07-26T15:34:43.420 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2021-07-26T15:34:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:34:43.421 INFO:teuthology.orchestra.run.smithi111.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2021-07-26T15:34:43.423 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:34:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:34:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:34:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2021-07-26T15:34:43.424 INFO:teuthology.orchestra.run.smithi111.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-07-26T15:34:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-07-26T15:34:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-07-26T15:34:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-07-26T15:34:43.425 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-07-26T15:34:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2021-07-26T15:34:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-07-26T15:34:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:34:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:34:43.426 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:34:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:34:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:34:43.427 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2021-07-26T15:34:43.427 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 librbd1 2021-07-26T15:34:43.428 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2021-07-26T15:34:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:34:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-07-26T15:34:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2021-07-26T15:34:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:34:43.429 INFO:teuthology.orchestra.run.smithi018.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2021-07-26T15:34:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:34:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:34:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:34:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2021-07-26T15:34:43.431 INFO:teuthology.orchestra.run.smithi018.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-07-26T15:34:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-07-26T15:34:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-07-26T15:34:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-07-26T15:34:43.432 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-07-26T15:34:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2021-07-26T15:34:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-07-26T15:34:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:34:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:34:43.433 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:34:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:34:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:34:43.434 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2021-07-26T15:34:43.434 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 librbd1 2021-07-26T15:34:43.555 INFO:teuthology.orchestra.run.smithi111.stdout:2 upgraded, 99 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:34:43.556 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 172 MB of archives. 2021-07-26T15:34:43.556 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 796 MB of additional disk space will be used. 2021-07-26T15:34:43.556 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.5-102-gc6a1fa5a-1focal [3,816 B] 2021-07-26T15:34:43.568 INFO:teuthology.orchestra.run.smithi018.stdout:2 upgraded, 99 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:34:43.568 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 172 MB of archives. 2021-07-26T15:34:43.569 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 796 MB of additional disk space will be used. 2021-07-26T15:34:43.569 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.5-102-gc6a1fa5a-1focal [3,816 B] 2021-07-26T15:34:43.603 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.5-102-gc6a1fa5a-1focal [3,285 kB] 2021-07-26T15:34:43.610 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:34:43.615 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.5-102-gc6a1fa5a-1focal [3,285 kB] 2021-07-26T15:34:43.620 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:34:43.846 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,362 kB] 2021-07-26T15:34:43.887 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,362 kB] 2021-07-26T15:34:43.980 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:34:43.990 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2021-07-26T15:34:44.004 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:34:44.015 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:34:44.016 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2021-07-26T15:34:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:34:44.024 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:34:44.052 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.5-102-gc6a1fa5a-1focal [715 kB] 2021-07-26T15:34:44.062 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:34:44.110 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.5-102-gc6a1fa5a-1focal [409 kB] 2021-07-26T15:34:44.123 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.5-102-gc6a1fa5a-1focal [22.0 kB] 2021-07-26T15:34:44.124 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.5-102-gc6a1fa5a-1focal [212 kB] 2021-07-26T15:34:44.131 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.5-102-gc6a1fa5a-1focal [31.2 kB] 2021-07-26T15:34:44.132 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.5-102-gc6a1fa5a-1focal [385 kB] 2021-07-26T15:34:44.152 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.5-102-gc6a1fa5a-1focal [715 kB] 2021-07-26T15:34:44.165 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:34:44.175 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.5-102-gc6a1fa5a-1focal [409 kB] 2021-07-26T15:34:44.181 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,686 kB] 2021-07-26T15:34:44.188 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:34:44.195 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:34:44.195 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:34:44.217 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:34:44.224 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:34:44.227 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:34:44.231 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:34:44.232 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.5-102-gc6a1fa5a-1focal [22.0 kB] 2021-07-26T15:34:44.233 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.5-102-gc6a1fa5a-1focal [212 kB] 2021-07-26T15:34:44.234 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:34:44.239 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.5-102-gc6a1fa5a-1focal [31.2 kB] 2021-07-26T15:34:44.240 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.5-102-gc6a1fa5a-1focal [385 kB] 2021-07-26T15:34:44.245 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:34:44.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:34:44.249 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:34:44.253 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:34:44.253 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,686 kB] 2021-07-26T15:34:44.258 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:34:44.262 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:34:44.276 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:34:44.277 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:34:44.278 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:34:44.280 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:34:44.309 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:34:44.312 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:34:44.313 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:34:44.360 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:34:44.361 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:34:44.362 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:34:44.364 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:34:44.366 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:34:44.370 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:34:44.373 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:34:44.391 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:34:44.394 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:34:44.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:34:44.400 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:34:44.404 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:34:44.405 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:34:44.423 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:34:44.434 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.5-102-gc6a1fa5a-1focal [116 kB] 2021-07-26T15:34:44.435 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.5-102-gc6a1fa5a-1focal [447 kB] 2021-07-26T15:34:44.438 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.5-102-gc6a1fa5a-1focal [22.4 MB] 2021-07-26T15:34:44.442 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:34:44.461 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:34:44.462 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:34:44.474 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:34:44.474 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:34:44.476 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:34:44.518 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.5-102-gc6a1fa5a-1focal [116 kB] 2021-07-26T15:34:44.521 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.5-102-gc6a1fa5a-1focal [447 kB] 2021-07-26T15:34:44.524 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:34:44.525 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:34:44.528 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:34:44.536 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.5-102-gc6a1fa5a-1focal [22.4 MB] 2021-07-26T15:34:44.536 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:34:44.540 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:34:44.540 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:34:44.544 INFO:teuthology.orchestra.run.smithi018.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:34:44.556 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:34:44.562 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:34:44.564 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:34:44.565 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:34:44.568 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:34:44.570 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:34:44.572 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:34:44.607 INFO:teuthology.orchestra.run.smithi018.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:34:44.609 INFO:teuthology.orchestra.run.smithi018.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:34:44.610 INFO:teuthology.orchestra.run.smithi018.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:34:44.639 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:34:44.639 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:34:44.703 INFO:teuthology.orchestra.run.smithi018.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:34:45.071 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:34:45.138 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:34:45.142 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:34:45.170 INFO:teuthology.orchestra.run.smithi018.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:34:45.241 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:34:45.241 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:34:45.242 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:34:45.243 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:34:45.244 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:34:45.245 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:34:45.246 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:34:45.279 INFO:teuthology.orchestra.run.smithi018.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:34:45.283 INFO:teuthology.orchestra.run.smithi018.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:34:45.305 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:34:45.306 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:34:45.337 INFO:teuthology.orchestra.run.smithi018.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:34:45.337 INFO:teuthology.orchestra.run.smithi018.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:34:45.338 INFO:teuthology.orchestra.run.smithi018.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:34:45.339 INFO:teuthology.orchestra.run.smithi018.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:34:45.339 INFO:teuthology.orchestra.run.smithi018.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:34:45.366 INFO:teuthology.orchestra.run.smithi018.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:34:45.367 INFO:teuthology.orchestra.run.smithi018.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:34:45.392 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:34:45.397 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:34:45.400 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:34:45.401 INFO:teuthology.orchestra.run.smithi018.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:34:45.401 INFO:teuthology.orchestra.run.smithi018.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:34:45.403 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:34:45.405 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:34:45.409 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:34:45.410 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:34:45.413 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:34:45.474 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:34:45.475 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:34:45.486 INFO:teuthology.orchestra.run.smithi018.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:34:45.490 INFO:teuthology.orchestra.run.smithi018.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:34:45.492 INFO:teuthology.orchestra.run.smithi018.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:34:45.495 INFO:teuthology.orchestra.run.smithi018.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:34:45.496 INFO:teuthology.orchestra.run.smithi018.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:34:45.504 INFO:teuthology.orchestra.run.smithi018.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:34:45.506 INFO:teuthology.orchestra.run.smithi018.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:34:45.510 INFO:teuthology.orchestra.run.smithi018.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:34:45.556 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:34:45.557 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:34:45.559 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:34:45.571 INFO:teuthology.orchestra.run.smithi018.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:34:45.572 INFO:teuthology.orchestra.run.smithi018.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:34:45.579 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:34:45.579 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:34:45.580 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:34:45.580 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:34:45.582 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:34:45.638 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:34:45.639 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:34:45.653 INFO:teuthology.orchestra.run.smithi018.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:34:45.654 INFO:teuthology.orchestra.run.smithi018.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:34:45.655 INFO:teuthology.orchestra.run.smithi018.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:34:45.677 INFO:teuthology.orchestra.run.smithi018.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:34:45.677 INFO:teuthology.orchestra.run.smithi018.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:34:45.678 INFO:teuthology.orchestra.run.smithi018.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:34:45.679 INFO:teuthology.orchestra.run.smithi018.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:34:45.681 INFO:teuthology.orchestra.run.smithi018.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:34:45.721 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:34:45.725 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:34:45.735 INFO:teuthology.orchestra.run.smithi018.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:34:45.736 INFO:teuthology.orchestra.run.smithi018.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:34:45.817 INFO:teuthology.orchestra.run.smithi018.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:34:45.820 INFO:teuthology.orchestra.run.smithi018.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:34:45.914 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.5-102-gc6a1fa5a-1focal [5,872 kB] 2021-07-26T15:34:46.171 INFO:teuthology.orchestra.run.smithi018.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.5-102-gc6a1fa5a-1focal [5,872 kB] 2021-07-26T15:34:46.207 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.5-102-gc6a1fa5a-1focal [186 kB] 2021-07-26T15:34:46.213 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.5-102-gc6a1fa5a-1focal [1,501 kB] 2021-07-26T15:34:46.331 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.5-102-gc6a1fa5a-1focal [6,929 kB] 2021-07-26T15:34:46.470 INFO:teuthology.orchestra.run.smithi018.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.5-102-gc6a1fa5a-1focal [186 kB] 2021-07-26T15:34:46.514 INFO:teuthology.orchestra.run.smithi018.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.5-102-gc6a1fa5a-1focal [1,501 kB] 2021-07-26T15:34:46.604 INFO:teuthology.orchestra.run.smithi018.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.5-102-gc6a1fa5a-1focal [6,929 kB] 2021-07-26T15:34:46.739 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.5-102-gc6a1fa5a-1focal [26.0 MB] 2021-07-26T15:34:47.073 INFO:teuthology.orchestra.run.smithi018.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.5-102-gc6a1fa5a-1focal [26.0 MB] 2021-07-26T15:34:48.516 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.5-102-gc6a1fa5a-1focal [3,908 B] 2021-07-26T15:34:48.517 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [817 kB] 2021-07-26T15:34:48.528 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.5-102-gc6a1fa5a-1focal [2,306 kB] 2021-07-26T15:34:48.592 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.5-102-gc6a1fa5a-1focal [65.7 kB] 2021-07-26T15:34:48.593 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.5-102-gc6a1fa5a-1focal [84.0 kB] 2021-07-26T15:34:48.596 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.5-102-gc6a1fa5a-1focal [2,360 kB] 2021-07-26T15:34:48.742 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.5-102-gc6a1fa5a-1focal [7,886 kB] 2021-07-26T15:34:48.953 INFO:teuthology.orchestra.run.smithi018.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.5-102-gc6a1fa5a-1focal [3,908 B] 2021-07-26T15:34:48.954 INFO:teuthology.orchestra.run.smithi018.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [817 kB] 2021-07-26T15:34:48.964 INFO:teuthology.orchestra.run.smithi018.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.5-102-gc6a1fa5a-1focal [2,306 kB] 2021-07-26T15:34:49.084 INFO:teuthology.orchestra.run.smithi018.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.5-102-gc6a1fa5a-1focal [65.7 kB] 2021-07-26T15:34:49.118 INFO:teuthology.orchestra.run.smithi018.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.5-102-gc6a1fa5a-1focal [84.0 kB] 2021-07-26T15:34:49.120 INFO:teuthology.orchestra.run.smithi018.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.5-102-gc6a1fa5a-1focal [2,360 kB] 2021-07-26T15:34:49.222 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.5-102-gc6a1fa5a-1focal [4,020 B] 2021-07-26T15:34:49.222 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.5-102-gc6a1fa5a-1focal [126 kB] 2021-07-26T15:34:49.225 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.5-102-gc6a1fa5a-1focal [49.3 MB] 2021-07-26T15:34:49.263 INFO:teuthology.orchestra.run.smithi018.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.5-102-gc6a1fa5a-1focal [7,886 kB] 2021-07-26T15:34:49.815 INFO:teuthology.orchestra.run.smithi018.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.5-102-gc6a1fa5a-1focal [4,020 B] 2021-07-26T15:34:49.815 INFO:teuthology.orchestra.run.smithi018.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.5-102-gc6a1fa5a-1focal [126 kB] 2021-07-26T15:34:49.819 INFO:teuthology.orchestra.run.smithi018.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.5-102-gc6a1fa5a-1focal [49.3 MB] 2021-07-26T15:34:52.539 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.5-102-gc6a1fa5a-1focal [20.8 kB] 2021-07-26T15:34:52.540 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.5-102-gc6a1fa5a-1focal [11.3 MB] 2021-07-26T15:34:53.088 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [77.6 kB] 2021-07-26T15:34:53.353 INFO:teuthology.orchestra.run.smithi018.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.5-102-gc6a1fa5a-1focal [20.8 kB] 2021-07-26T15:34:53.354 INFO:teuthology.orchestra.run.smithi018.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.5-102-gc6a1fa5a-1focal [11.3 MB] 2021-07-26T15:34:53.608 INFO:teuthology.orchestra.run.smithi018.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [77.6 kB] 2021-07-26T15:34:53.667 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 172 MB in 10s (17.8 MB/s) 2021-07-26T15:34:53.737 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjaeger. 2021-07-26T15:34:53.792 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:34:53.796 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-libjaeger_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:53.835 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:54.180 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:34:54.193 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 172 MB in 10s (17.0 MB/s) 2021-07-26T15:34:54.196 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:34:54.280 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:34:54.281 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjaeger. 2021-07-26T15:34:54.336 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:34:54.340 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../000-libjaeger_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:54.380 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:54.576 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-librbd1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:54.675 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:34:54.875 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:34:54.893 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../001-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:34:54.983 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../002-librbd1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:55.337 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-librados2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:55.370 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:34:55.455 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:34:56.074 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../003-librados2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:56.133 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:34:56.149 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libcephfs2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:56.191 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:56.208 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:34:56.508 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:34:56.527 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-python3-rados_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:56.569 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:56.811 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:34:56.829 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../004-libcephfs2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:56.861 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:56.913 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:34:56.929 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-python3-ceph-argparse_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:34:56.971 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:57.274 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:34:57.290 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-python3-cephfs_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:57.322 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:34:57.339 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../005-python3-rados_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:57.357 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:57.380 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:57.635 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:34:57.650 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-python3-ceph-common_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:34:57.693 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:57.758 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:34:57.776 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../006-python3-ceph-argparse_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:34:57.817 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:57.971 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:34:57.988 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:34:58.029 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:34:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:34:58.118 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../007-python3-cephfs_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:58.152 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:58.307 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:34:58.323 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-python3-rbd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:58.365 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:58.464 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:34:58.481 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../008-python3-ceph-common_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:34:58.522 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:58.718 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2021-07-26T15:34:58.733 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2021-07-26T15:34:58.776 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:34:58.859 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:34:58.874 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:34:58.917 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:34:59.096 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:34:59.112 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:34:59.146 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:34:59.195 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:34:59.210 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../010-python3-rbd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:59.253 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:59.482 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:34:59.500 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:34:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2021-07-26T15:34:59.540 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:34:59.548 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../011-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2021-07-26T15:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:34:59.910 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:34:59.925 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-librgw2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:34:59.959 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:34:59.968 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:34:59.975 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../012-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:35:00.017 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:35:00.395 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:35:00.411 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../013-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:35:00.453 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:35:00.512 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:35:00.528 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-rgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:00.562 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:00.773 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../014-librgw2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:00.898 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:35:00.916 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:35:00.956 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:35:01.318 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:35:01.336 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:35:01.376 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:35:01.425 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:35:01.442 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../015-python3-rgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:01.483 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:01.695 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:35:01.714 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-libradosstriper1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:01.753 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:01.837 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:35:01.853 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../016-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:35:01.894 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:35:02.189 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:35:02.190 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:35:02.205 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../017-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:35:02.209 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-ceph-common_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:02.248 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:02.256 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:35:02.542 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:35:02.558 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../018-libradosstriper1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:02.600 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:03.095 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:35:03.113 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../019-ceph-common_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:03.153 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:04.562 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:35:04.579 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-ceph-base_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:04.630 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:05.459 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:35:05.479 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../020-ceph-base_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:05.516 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:35:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:05.532 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:35:05.574 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:35:05.995 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:35:06.011 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:35:06.053 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:35:06.322 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:35:06.342 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-ceph-mgr-modules-core_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:06.389 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:06.539 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:35:06.554 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../021-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:35:06.598 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:35:06.785 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:35:06.802 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:35:06.852 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:35:07.113 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:35:07.130 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:35:07.159 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:35:07.162 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:35:07.177 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../022-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:35:07.217 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:35:07.509 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:35:07.511 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:35:07.523 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:35:07.529 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../023-ceph-mgr-modules-core_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:07.557 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:35:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:07.811 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:35:07.830 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:35:07.860 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:35:07.933 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:35:07.952 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../024-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:35:08.008 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:35:08.185 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:35:08.203 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:35:08.247 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:35:08.319 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:35:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:35:08.402 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:35:08.549 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:35:08.567 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:35:08.607 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:35:08.764 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:35:08.781 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../026-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:35:08.822 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:35:08.895 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:35:08.910 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:35:08.945 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:35:09.184 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:35:09.201 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:35:09.205 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:35:09.221 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:35:09.242 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:35:09.256 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:35:09.558 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:35:09.570 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:35:09.574 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:35:09.587 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:35:09.616 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:35:09.953 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:35:09.964 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:35:09.971 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:35:09.981 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:35:10.011 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:35:10.117 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:35:10.372 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:35:10.388 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:35:10.430 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:35:10.759 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:35:10.776 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:35:10.800 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:35:10.816 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:35:10.818 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:35:10.853 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:35:11.137 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:35:11.154 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:35:11.162 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:35:11.178 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:35:11.187 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:35:11.220 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:35:11.440 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:35:11.458 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:35:11.524 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:35:11.557 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:35:11.573 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:35:11.614 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:35:11.868 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:35:11.883 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:35:11.926 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:35:11.934 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:35:11.950 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:35:12.017 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:35:12.237 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:35:12.256 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:35:12.295 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:35:12.312 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:35:12.331 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:35:12.371 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:35:12.632 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:35:12.648 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:35:12.690 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:35:12.790 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:35:12.806 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:35:12.860 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:35:13.001 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:35:13.017 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:35:13.059 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:35:13.229 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:35:13.245 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:35:13.287 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:35:13.431 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:35:13.448 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:35:13.489 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:35:13.615 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:35:13.632 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:35:13.673 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:35:13.859 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:35:13.876 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-ceph-mgr_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:13.917 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:35:14.067 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:35:14.371 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:35:14.389 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:35:14.429 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:35:14.437 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:35:14.453 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-ceph-mon_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:14.495 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:14.740 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:35:14.757 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:35:14.799 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:35:15.135 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:35:15.150 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:35:16.106 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:35:16.122 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:35:16.198 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:35:16.199 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:35:16.218 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-ceph-osd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:16.257 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:16.568 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:35:16.585 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../043-ceph-mgr_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:16.626 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:17.121 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:35:17.137 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../044-ceph-mon_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:17.197 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../045-ceph-osd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:18.482 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:18.887 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2021-07-26T15:35:18.903 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:18.945 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:19.273 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:35:19.290 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-ceph-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:19.331 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:19.751 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:35:19.766 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-ceph-mds_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:19.809 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:20.362 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:35:20.379 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-cephadm_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:20.421 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:20.723 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:35:20.743 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:35:20.781 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:35:21.134 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:35:21.154 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-ceph-mgr-cephadm_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:21.192 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:21.230 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph. 2021-07-26T15:35:21.247 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../046-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:21.313 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:21.521 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:35:21.536 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:35:21.579 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:35:21.632 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:35:21.648 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../047-ceph-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:21.691 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:21.873 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:35:21.893 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:35:21.931 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:35:22.077 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:35:22.094 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../048-ceph-mds_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:22.127 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:22.201 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:35:22.220 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:35:22.259 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:35:22.612 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:35:22.630 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:35:22.670 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:35:22.671 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:35:22.689 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../049-cephadm_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:22.730 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:22.998 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:35:23.013 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:23.064 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:23.074 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../050-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:35:23.486 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:35:23.504 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../051-ceph-mgr-cephadm_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:23.544 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:23.897 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:35:23.913 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../052-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:35:23.947 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:35:24.064 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:35:24.081 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:35:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:35:24.141 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:35:24.158 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../053-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:35:24.207 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:35:24.458 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:35:24.477 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:35:24.485 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:35:24.502 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:35:24.517 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:35:24.543 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:35:24.828 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:35:24.847 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:35:24.884 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:35:24.894 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:35:24.903 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../055-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:35:24.946 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:35:25.291 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:35:25.307 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:25.349 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:26.375 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:35:26.396 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../057-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:35:26.449 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:35:26.745 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:35:26.746 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:35:26.761 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../058-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:35:26.766 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:35:26.796 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:26.802 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:35:27.156 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:35:27.173 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../059-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:35:27.213 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:35:27.308 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:35:27.327 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:35:27.366 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:35:27.736 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:35:27.752 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:35:27.803 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:35:28.574 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:35:28.615 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:28.636 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:35:28.652 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:28.703 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:29.161 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:35:29.180 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../061-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:35:29.219 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:35:29.614 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:35:29.630 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../062-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:35:29.672 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:29.773 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:35:29.789 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:35:29.830 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:35:30.167 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:35:30.184 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:35:30.225 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:35:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:35:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:30.422 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:30.562 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:35:30.578 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:35:30.620 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:35:30.956 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:35:30.973 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:35:31.014 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:35:31.317 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:35:31.335 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:35:31.367 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:35:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:35:31.721 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:35:31.728 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../064-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:35:31.739 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:35:31.767 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:35:31.778 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:35:32.082 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:35:32.099 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:35:32.119 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:35:32.137 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../065-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:35:32.139 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:35:32.178 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:35:32.443 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:35:32.459 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:35:32.515 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:35:32.531 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../066-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:35:32.534 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:35:32.606 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:35:32.855 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:35:32.872 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:35:32.913 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:35:32.917 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:35:32.934 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../067-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:35:32.975 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:35:33.225 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:35:33.241 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:35:33.284 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:35:33.312 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:35:33.332 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../068-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:35:33.370 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:35:33.716 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:35:33.735 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../069-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:35:33.774 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:35:33.855 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:35:33.872 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-ceph-mgr-k8sevents_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:33.912 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:34.129 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:35:34.145 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../070-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:35:34.183 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:35:34.265 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:35:34.283 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:35:34.323 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:35:34.504 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:35:34.523 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../071-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:35:34.562 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:35:34.660 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:35:34.679 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:35:34.718 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:34.907 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:35:34.924 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../072-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:35:34.965 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:35:35.020 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2021-07-26T15:35:35.039 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:35:35.078 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:35.327 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:35:35.331 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2021-07-26T15:35:35.345 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../073-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:35:35.350 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:35:35.385 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:35:35.389 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:35:35.776 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:35:35.795 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:35:35.861 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:35:35.956 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:35:35.975 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../074-ceph-mgr-k8sevents_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:35:36.016 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:36.121 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:35:36.137 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:35:36.179 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:35:36.367 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:35:36.383 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../075-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:35:36.485 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:35:36.685 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2021-07-26T15:35:36.703 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-libsqlite3-mod-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:36.743 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:36.795 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:35:36.816 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../076-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:35:36.845 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:37.029 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:35:37.047 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-ceph-test_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:37.087 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:37.098 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package jq. 2021-07-26T15:35:37.116 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../077-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:35:37.189 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:37.475 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package socat. 2021-07-26T15:35:37.493 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../078-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:35:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:35:37.912 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:35:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../079-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:35:37.970 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:35:38.256 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:35:38.276 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../080-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:35:38.314 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:35:38.805 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2021-07-26T15:35:38.824 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../081-libsqlite3-mod-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:38.862 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:39.149 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:35:39.168 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../082-ceph-test_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:39.240 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:41.446 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:35:41.464 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-libcephfs-dev_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:41.507 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:41.905 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:35:41.924 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:35:41.977 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:35:42.351 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:35:42.367 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:35:42.407 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:35:42.735 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:35:42.752 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:35:42.793 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:35:43.112 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:35:43.130 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:35:43.171 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:35:43.498 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:35:43.516 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:35:43.556 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:35:43.727 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:35:43.746 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../083-libcephfs-dev_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:43.785 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:43.935 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:35:43.954 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:35:43.995 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:35:44.214 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:35:44.231 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../084-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:35:44.289 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:35:44.479 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:35:44.498 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:35:44.548 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:35:44.644 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:35:44.661 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../085-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:35:44.706 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:35:44.865 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:35:44.886 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:35:44.923 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:35:45.013 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:35:45.030 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../086-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:35:45.071 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:35:45.277 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:35:45.295 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:35:45.335 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:35:45.391 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:35:45.408 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../087-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:35:45.482 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:35:45.647 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:35:45.666 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:35:45.705 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:35:45.711 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:35:45.729 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../088-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:35:45.762 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:35:46.068 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:35:46.080 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:35:46.085 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:35:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../089-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:35:46.126 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:35:46.129 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:35:46.455 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:35:46.472 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:35:46.513 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:35:46.567 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:35:46.583 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../090-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:35:46.616 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:35:46.875 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:35:46.892 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:35:46.897 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:35:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../091-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:35:46.932 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:35:46.955 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:35:47.218 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:35:47.239 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:35:47.277 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:35:47.283 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:35:47.303 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../092-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:35:47.341 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:35:47.661 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:35:47.700 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../093-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:35:47.701 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:35:47.701 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:35:47.719 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:35:47.722 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:35:48.100 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:35:48.117 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../094-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:35:48.159 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:35:48.166 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:35:48.186 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-radosgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:48.219 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:48.477 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:35:48.496 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../095-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:35:48.564 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:35:48.858 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:35:48.877 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../096-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:35:48.919 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:35:49.245 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:35:49.262 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../097-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:35:49.304 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:35:49.450 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:35:49.466 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-rbd-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:49.507 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../098-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:35:49.732 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:35:49.800 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:35:50.121 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:35:50.169 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:35:50.189 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../099-radosgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:50.223 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:35:50.227 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:50.321 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:35:50.509 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:51.071 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2021-07-26T15:35:51.232 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:35:51.584 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:35:51.659 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:35:51.677 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../100-rbd-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:35:51.716 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:51.885 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:35:52.011 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:35:52.020 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:35:52.321 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:35:52.363 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:35:52.464 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:35:52.565 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:35:52.714 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:35:52.792 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:53.000 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:35:53.286 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user cephadm....done 2021-07-26T15:35:53.498 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:35:53.570 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:35:53.841 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:35:53.862 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:54.188 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:54.192 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:35:54.314 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:35:54.318 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:35:54.583 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:35:54.676 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:35:54.867 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:35:55.080 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:35:55.243 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:35:55.348 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:35:55.528 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:35:55.624 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:35:55.880 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:35:55.934 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:35:56.164 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:56.244 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:56.290 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:35:56.545 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:56.616 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:35:56.671 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:35:56.918 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:35:56.963 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:35:57.257 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:35:57.261 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:35:57.811 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:35:57.902 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:35:58.098 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:35:58.502 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:35:58.523 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:58.623 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:35:58.879 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:35:58.958 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:35:59.238 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:35:59.280 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:35:59.389 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:35:59.585 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:35:59.682 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:35:59.711 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:36:00.020 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:36:00.034 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:36:00.187 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:36:00.422 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:36:00.477 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:36:00.603 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:36:00.729 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:36:00.849 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:36:01.072 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:36:01.209 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:36:01.348 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:36:01.360 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:01.650 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:36:01.670 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:36:01.809 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:36:02.086 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:36:02.148 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:36:02.378 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:36:02.433 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:36:02.558 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:36:02.680 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:36:02.995 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:36:03.083 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:36:03.270 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:36:03.332 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:36:03.475 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:36:03.588 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:36:03.731 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:36:03.793 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:36:04.009 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:36:04.145 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:36:04.287 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:36:04.291 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:36:04.417 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:36:04.609 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:36:04.756 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:36:04.939 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:36:05.041 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:05.194 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:36:05.196 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:36:05.330 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:36:05.691 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:36:06.042 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:36:06.175 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:36:06.301 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:36:06.629 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:36:06.659 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:06.819 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:06.907 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:06.941 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:36:07.068 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:36:07.087 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:36:07.481 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:36:07.780 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:36:08.081 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:36:08.416 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:08.559 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:36:08.582 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:08.708 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:08.834 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:36:08.879 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:08.960 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:36:09.010 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:36:09.325 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:36:09.358 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:36:09.657 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:36:09.963 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:36:10.315 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:10.361 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:10.441 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:36:10.487 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:36:10.613 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:36:10.755 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:36:10.784 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:10.911 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:36:11.065 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:36:11.191 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:36:11.237 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:36:11.486 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:36:11.819 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:11.945 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:12.169 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:36:12.170 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:36:12.292 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:12.418 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:36:12.544 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:36:12.638 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:12.695 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:36:12.781 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:36:13.015 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:36:13.074 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:36:13.172 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:36:13.451 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:36:13.465 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:36:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:13.811 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:13.884 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:13.937 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:14.064 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:14.109 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:36:14.109 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:36:14.206 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:36:14.569 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:14.621 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:36:14.728 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:36:14.931 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:15.029 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:36:15.057 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:15.356 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:36:15.375 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:36:15.709 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:15.835 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:16.086 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:36:16.307 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:16.483 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:36:16.793 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:16.876 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2021-07-26T15:36:16.919 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:17.229 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:36:17.244 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2021-07-26T15:36:17.403 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2021-07-26T15:36:17.423 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:36:17.574 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:36:17.878 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:36:18.181 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:18.374 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:18.534 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:18.787 INFO:teuthology.orchestra.run.smithi018.stdout:Adding group ceph....done 2021-07-26T15:36:18.804 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:36:18.805 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user ceph....done 2021-07-26T15:36:19.381 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties....done 2021-07-26T15:36:19.406 INFO:teuthology.orchestra.run.smithi018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:36:19.436 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:19.556 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:36:19.766 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:36:19.883 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:36:20.171 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:20.352 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:20.402 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:36:20.402 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:36:20.487 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:20.763 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:36:20.764 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:36:20.831 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:21.075 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:36:21.076 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:36:21.430 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:21.524 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:21.784 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:36:22.074 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:36:22.075 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:36:22.254 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:22.511 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:36:22.512 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:36:22.517 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:22.660 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:22.803 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:22.955 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:23.030 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:36:23.030 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:36:23.195 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:36:23.195 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:36:23.632 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:23.655 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:23.853 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:24.148 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:36:24.179 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:36:24.179 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:36:24.432 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:36:24.634 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:24.760 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:24.911 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:25.122 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:36:25.122 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:36:25.587 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:25.730 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:25.856 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:36:26.026 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:36:26.325 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:36:27.469 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:36:27.904 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:36:27.906 DEBUG:teuthology.parallel:result is None 2021-07-26T15:36:29.395 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:36:29.809 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:36:29.812 DEBUG:teuthology.parallel:result is None 2021-07-26T15:36:29.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:36:29.860 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:36:29.865 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:36:29.865 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:36:29.866 INFO:teuthology.packaging:ref: None 2021-07-26T15:36:29.866 INFO:teuthology.packaging:tag: None 2021-07-26T15:36:29.866 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:36:29.867 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:36:29.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:36:30.108 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:36:30.130 INFO:teuthology.orchestra.run.smithi018.stdout:16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:36:30.131 INFO:teuthology.packaging:The installed version of ceph is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:36:30.131 INFO:teuthology.task.install:The correct ceph version 16.2.5-102-gc6a1fa5a-1focal is installed. 2021-07-26T15:36:30.132 DEBUG:teuthology.orchestra.run.smithi111:> sudo lsb_release -is 2021-07-26T15:36:30.187 INFO:teuthology.orchestra.run.smithi111.stdout:Ubuntu 2021-07-26T15:36:30.192 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:36:30.192 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:36:30.193 INFO:teuthology.packaging:ref: None 2021-07-26T15:36:30.195 INFO:teuthology.packaging:tag: None 2021-07-26T15:36:30.195 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:36:30.195 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:36:30.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:36:30.422 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:36:30.444 INFO:teuthology.orchestra.run.smithi111.stdout:16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:36:30.445 INFO:teuthology.packaging:The installed version of ceph is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:36:30.445 INFO:teuthology.task.install:The correct ceph version 16.2.5-102-gc6a1fa5a-1focal is installed. 2021-07-26T15:36:30.446 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-07-26T15:36:30.446 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:30.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:36:30.463 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:30.464 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:36:30.501 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-07-26T15:36:30.502 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:30.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:36:30.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:36:30.575 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:30.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:36:30.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:36:30.602 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-07-26T15:36:30.602 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:30.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:36:30.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:36:30.631 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:30.632 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:36:30.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:36:30.707 INFO:teuthology.run_tasks:Running task ceph... 2021-07-26T15:36:30.783 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-07-26T15:36:30.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2021-07-26T15:36:30.787 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2021-07-26T15:36:30.803 INFO:tasks.ceph:Disabling ceph logrotate... 2021-07-26T15:36:30.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2021-07-26T15:36:30.806 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2021-07-26T15:36:30.816 INFO:tasks.ceph:Creating extra log directories... 2021-07-26T15:36:30.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-07-26T15:36:30.819 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-07-26T15:36:30.886 INFO:tasks.ceph:Creating ceph cluster c1... 2021-07-26T15:36:30.886 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-07-26T15:36:30.887 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838', 'branch': 'wip-kefu-testing-2021-07-24-1158', 'description': 'upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm supported-random-distro$/{ubuntu_latest} tasks upgrade/primary}', 'email': None, 'first_in_suite': False, 'job_id': '6293838', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi', 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-07-24-1158'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'pacific', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-kefu-testing-2021-07-24-1158', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'sleep_before_teardown': 0, 'suite': 'upgrade', 'suite_branch': 'wip-kefu-testing-2021-07-24-1158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'targets': {'smithi018.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mYLgQHG+4OHtOpcPVGk/r6+FAwkPgBjs5qMoPlQVe3igdN/iHazC9qWmzv7WDD+Iyx0KFs23aPBlseCDS67/RiXcbvgiyMWGUDjPT1aubQppJiiPgN1bjfBIoVDWVt6GT7y28EpV2bz5vOlMwKPo6K96sBaCWUwAAIwFPGZtxum82gLOnVyqvLVwPqNfUhY4YtkalF4/3SeTwqFYnyz1ZbsmQO+fhIdO3Zb0dotSb1/XhF/CqRCmtL2+4KoMPww7nEypzs2YqkvYZo4YqP5fn1qqjQ9y9pBUyRFga9rS5PpINWBx0mBo6rCxhTWVkEMLTbDR+uYH4M+mm1538Lf/xZZQ4ZVOJA90VomPgkgqVBPfuXtBjMe9/DkHFk2VTHCdBRX2HW+8P2NlOyayVJqmnps9zfT8XpI9V6ce+ptMkFWWZE59ORl31s8xLnWZH0ZsmpMHBIUUeRkmPM3iQhgxkSL8enD4wHOtZimtUqfoKkmRqGBa97PagzOLBWrtvns=', 'smithi111.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzSKexTFHqtNZ7AxtWSSinQgeX1iKzjFCnKS4MNtilyXBe/u5uaC6Jo9NYwc33XacM0VOwG4gYlijpR5Eg5mwBflSQ/8b+Y8xNdamO1JjyMwftdcfzoTTO9aRZUkaCODx4TZTK01INqeBvMtJR/kzYg4rSH5NBxvCN8uHlOY5PKLU8FA9Y8qJuQbT2rTWp7+MHKNzzCxq0e1sDQ1EdiJvYfJKKmhHIDuO5E1q0t6B1teubqxJ6DkkUwCfSahA7GT43rFObI09WHnf08FcJY6TkPp0FcQXJwXYqTqLqd1etA4M2YvjOQJcVrAxcE2X0Dhe/d2qmcmbIGInRe7UXTEeJ3TMlxf87aFsRvXu+Czq/q2mflWiTQUYUB2OTVK5GEKUdh1EfRchd0OUtZsQ9AJj+YDXvMMLqc7tLXV5Vqfb0mWtysQJKs1CdIrragi2Lalm86/ncNGI+e5dTgdWm5B99mMunH2+mgh9ZMHONj3JYey5y+newLVeLPxu8pAFt/J8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b6f3efab84b70e18e86ec271a07564aeb4ed3bac', 'timestamp': '2021-07-26_15:05:01', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-07-26T15:36:30.888 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-07-26T15:36:30.891 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-07-26T15:36:30.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:36:30.900 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:36:30.915 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:30.916 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:36:30.960 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:36:30.960 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:36:30.971 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:36:30.971 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-07-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2021-07-26 15:33:40.920873136 +0000 2021-07-26T15:36:30.973 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2021-07-26 15:33:40.728873130 +0000 2021-07-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2021-07-26 15:33:40.728873130 +0000 2021-07-26T15:36:30.974 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2021-07-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2021-07-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2021-07-26T15:36:30.980 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000303031 s, 1.7 MB/s 2021-07-26T15:36:30.984 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:36:31.036 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:36:31.036 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:31.036 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-07-26T15:36:31.037 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:31.037 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2021-07-26 15:33:41.308873148 +0000 2021-07-26T15:36:31.037 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2021-07-26 15:33:41.164873144 +0000 2021-07-26T15:36:31.037 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2021-07-26 15:33:41.164873144 +0000 2021-07-26T15:36:31.037 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2021-07-26T15:36:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2021-07-26T15:36:31.046 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2021-07-26T15:36:31.046 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000290114 s, 1.8 MB/s 2021-07-26T15:36:31.050 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:36:31.058 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:36:31.058 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:31.058 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-07-26T15:36:31.058 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:31.059 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2021-07-26 15:33:41.524873155 +0000 2021-07-26T15:36:31.059 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2021-07-26 15:33:41.520873155 +0000 2021-07-26T15:36:31.059 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2021-07-26 15:33:41.520873155 +0000 2021-07-26T15:36:31.059 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2021-07-26T15:36:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2021-07-26T15:36:31.069 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2021-07-26T15:36:31.069 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000274818 s, 1.9 MB/s 2021-07-26T15:36:31.073 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:36:31.085 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:36:31.086 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:31.087 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-07-26T15:36:31.087 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:31.087 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2021-07-26 15:33:41.896873167 +0000 2021-07-26T15:36:31.088 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2021-07-26 15:33:41.892873167 +0000 2021-07-26T15:36:31.088 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2021-07-26 15:33:41.892873167 +0000 2021-07-26T15:36:31.089 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2021-07-26T15:36:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2021-07-26T15:36:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2021-07-26T15:36:31.094 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000247004 s, 2.1 MB/s 2021-07-26T15:36:31.098 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:31.098 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:36:31.099 INFO:tasks.ceph:Generating config... 2021-07-26T15:36:31.100 INFO:tasks.ceph:[client] debug rgw = 20 2021-07-26T15:36:31.101 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-07-26T15:36:31.101 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-07-26T15:36:31.102 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:36:31.102 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-07-26T15:36:31.102 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-07-26T15:36:31.103 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-07-26T15:36:31.103 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-07-26T15:36:31.103 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-07-26T15:36:31.103 INFO:tasks.ceph:[client] setgroup = ceph 2021-07-26T15:36:31.104 INFO:tasks.ceph:[client] setuser = ceph 2021-07-26T15:36:31.104 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-07-26T15:36:31.104 INFO:tasks.ceph:[mgr] debug ms = 1 2021-07-26T15:36:31.105 INFO:tasks.ceph:[mon] debug mon = 20 2021-07-26T15:36:31.105 INFO:tasks.ceph:[mon] debug ms = 1 2021-07-26T15:36:31.105 INFO:tasks.ceph:[mon] debug paxos = 20 2021-07-26T15:36:31.106 INFO:tasks.ceph:[osd] debug ms = 1 2021-07-26T15:36:31.106 INFO:tasks.ceph:[osd] debug osd = 20 2021-07-26T15:36:31.107 INFO:tasks.ceph:Setting up c1.mon.a... 2021-07-26T15:36:31.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-07-26T15:36:31.189 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/c1.keyring 2021-07-26T15:36:31.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-07-26T15:36:31.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:36:31.238 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.18')] 2021-07-26T15:36:31.239 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-07-26T15:36:31.240 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:31.241 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:36:31.287 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --print /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:31.323 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:31.323 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid ae04df7d-64d2-468a-9ab4-77d4ecc24293 2021-07-26T15:36:31.323 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2021-07-26T15:36:31.324 INFO:teuthology.orchestra.run.smithi018.stdout:fsid ae04df7d-64d2-468a-9ab4-77d4ecc24293 2021-07-26T15:36:31.324 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2021-07-26T15:36:31.322451+0000 2021-07-26T15:36:31.324 INFO:teuthology.orchestra.run.smithi018.stdout:created 2021-07-26T15:36:31.322451+0000 2021-07-26T15:36:31.325 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 0 (unknown) 2021-07-26T15:36:31.325 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2021-07-26T15:36:31.325 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2021-07-26T15:36:31.325 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-07-26T15:36:31.327 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:36:31.333 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID ae04df7d-64d2-468a-9ab4-77d4ecc24293... 2021-07-26T15:36:31.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-07-26T15:36:31.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-07-26T15:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2021-07-26T15:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2021-07-26T15:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2021-07-26T15:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2021-07-26T15:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2021-07-26T15:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2021-07-26T15:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2021-07-26T15:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2021-07-26T15:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2021-07-26T15:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2021-07-26T15:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2021-07-26T15:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2021-07-26T15:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2021-07-26T15:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2021-07-26T15:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2021-07-26T15:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2021-07-26T15:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2021-07-26T15:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2021-07-26T15:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2021-07-26T15:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2021-07-26T15:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2021-07-26T15:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = 172.21.15.18 2021-07-26T15:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = ae04df7d-64d2-468a-9ab4-77d4ecc24293 2021-07-26T15:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2021-07-26T15:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2021-07-26T15:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2021-07-26T15:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2021-07-26T15:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2021-07-26T15:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2021-07-26T15:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2021-07-26T15:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2021-07-26T15:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2021-07-26T15:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2021-07-26T15:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2021-07-26T15:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2021-07-26T15:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2021-07-26T15:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2021-07-26T15:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2021-07-26T15:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2021-07-26T15:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2021-07-26T15:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2021-07-26T15:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2021-07-26T15:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2021-07-26T15:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2021-07-26T15:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2021-07-26T15:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2021-07-26T15:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2021-07-26T15:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2021-07-26T15:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2021-07-26T15:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2021-07-26T15:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2021-07-26T15:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2021-07-26T15:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2021-07-26T15:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2021-07-26T15:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2021-07-26T15:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2021-07-26T15:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-07-26T15:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-07-26T15:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2021-07-26T15:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2021-07-26T15:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2021-07-26T15:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2021-07-26T15:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: debug rgw = 20 2021-07-26T15:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt require ssl = False 2021-07-26T15:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: rgw curl low speed time = 300 2021-07-26T15:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: rgw data log num shards = 4 2021-07-26T15:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: rgw md log max shards = 4 2021-07-26T15:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: rgw sync log trim interval = 0 2021-07-26T15:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: rgw sync obj etag verify = True 2021-07-26T15:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: setgroup = ceph 2021-07-26T15:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: setuser = ceph 2021-07-26T15:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2021-07-26T15:36:31.443 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2021-07-26T15:36:31.443 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2021-07-26T15:36:31.443 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:36:31.443 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2021-07-26T15:36:31.444 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.444 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2021-07-26T15:36:31.444 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.444 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2021-07-26T15:36:31.444 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.445 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2021-07-26T15:36:31.445 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2021-07-26T15:36:31.445 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.445 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2021-07-26T15:36:31.445 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2021-07-26T15:36:31.446 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.446 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:36:31.446 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2021-07-26T15:36:31.446 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.447 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:36:31.447 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:36:31.447 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.447 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2021-07-26T15:36:31.447 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.448 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2021-07-26T15:36:31.448 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2021-07-26T15:36:31.448 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:36:31.448 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:36:31.448 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2021-07-26T15:36:31.449 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:36:31.449 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2021-07-26T15:36:31.449 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:36:31.449 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:36:31.449 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2021-07-26T15:36:31.450 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.450 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:36:31.450 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.450 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2021-07-26T15:36:31.451 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.451 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2021-07-26T15:36:31.451 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.451 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2021-07-26T15:36:31.451 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2021-07-26T15:36:31.452 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2021-07-26T15:36:31.452 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = 172.21.15.18 2021-07-26T15:36:31.452 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = ae04df7d-64d2-468a-9ab4-77d4ecc24293 2021-07-26T15:36:31.452 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.452 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2021-07-26T15:36:31.453 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2021-07-26T15:36:31.453 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.453 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2021-07-26T15:36:31.453 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2021-07-26T15:36:31.454 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.454 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2021-07-26T15:36:31.454 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2021-07-26T15:36:31.454 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.454 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2021-07-26T15:36:31.455 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2021-07-26T15:36:31.455 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2021-07-26T15:36:31.455 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.455 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2021-07-26T15:36:31.455 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2021-07-26T15:36:31.456 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.456 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:36:31.456 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.456 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2021-07-26T15:36:31.456 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.457 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2021-07-26T15:36:31.457 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.457 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:36:31.457 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2021-07-26T15:36:31.458 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.458 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2021-07-26T15:36:31.458 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2021-07-26T15:36:31.458 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2021-07-26T15:36:31.458 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2021-07-26T15:36:31.459 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.459 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2021-07-26T15:36:31.459 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2021-07-26T15:36:31.459 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2021-07-26T15:36:31.459 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2021-07-26T15:36:31.460 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2021-07-26T15:36:31.460 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:31.460 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:31.460 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2021-07-26T15:36:31.460 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.461 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2021-07-26T15:36:31.461 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2021-07-26T15:36:31.461 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2021-07-26T15:36:31.461 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2021-07-26T15:36:31.461 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2021-07-26T15:36:31.462 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2021-07-26T15:36:31.462 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2021-07-26T15:36:31.462 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:31.462 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2021-07-26T15:36:31.462 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2021-07-26T15:36:31.463 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:31.463 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.463 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:36:31.464 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:36:31.464 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:36:31.464 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.464 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:36:31.464 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-07-26T15:36:31.465 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-07-26T15:36:31.465 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:31.465 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2021-07-26T15:36:31.465 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2021-07-26T15:36:31.466 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2021-07-26T15:36:31.466 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2021-07-26T15:36:31.466 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:36:31.466 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:36:31.466 INFO:teuthology.orchestra.run.smithi111.stdout: debug rgw = 20 2021-07-26T15:36:31.467 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt require ssl = False 2021-07-26T15:36:31.467 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:36:31.467 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:36:31.467 INFO:teuthology.orchestra.run.smithi111.stdout: rgw curl low speed time = 300 2021-07-26T15:36:31.467 INFO:teuthology.orchestra.run.smithi111.stdout: rgw data log num shards = 4 2021-07-26T15:36:31.468 INFO:teuthology.orchestra.run.smithi111.stdout: rgw md log max shards = 4 2021-07-26T15:36:31.468 INFO:teuthology.orchestra.run.smithi111.stdout: rgw sync log trim interval = 0 2021-07-26T15:36:31.468 INFO:teuthology.orchestra.run.smithi111.stdout: rgw sync obj etag verify = True 2021-07-26T15:36:31.468 INFO:teuthology.orchestra.run.smithi111.stdout: setgroup = ceph 2021-07-26T15:36:31.468 INFO:teuthology.orchestra.run.smithi111.stdout: setuser = ceph 2021-07-26T15:36:31.469 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2021-07-26T15:36:31.469 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-07-26T15:36:31.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-07-26T15:36:31.517 INFO:tasks.ceph:Copying monmap to all nodes... 2021-07-26T15:36:31.517 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:31.518 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2021-07-26T15:36:31.526 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:31.527 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2021-07-26T15:36:31.535 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:36:31.536 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:31.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/c1.keyring 2021-07-26T15:36:31.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:36:31.605 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:31.606 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:31.611 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:36:31.611 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:31.612 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/c1.keyring 2021-07-26T15:36:31.612 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:36:31.640 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:31.640 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:31.690 INFO:tasks.ceph:Setting up mon nodes... 2021-07-26T15:36:31.691 INFO:tasks.ceph:Setting up mgr nodes... 2021-07-26T15:36:31.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-07-26T15:36:31.735 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-07-26T15:36:31.737 INFO:tasks.ceph:Setting up mds nodes... 2021-07-26T15:36:31.738 INFO:tasks.ceph_client:Setting up client nodes... 2021-07-26T15:36:31.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-07-26T15:36:31.817 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/c1.client.0.keyring 2021-07-26T15:36:31.830 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-07-26T15:36:31.830 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:36:31.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-07-26T15:36:31.845 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:31.845 INFO:tasks.ceph:role: c1.osd.0 2021-07-26T15:36:31.845 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:36:31.846 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-07-26T15:36:31.933 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:36:31.934 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:36:31.934 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:36:31.934 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 2021-07-26T15:36:31.934 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:36:31.935 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:36:31.935 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:36:31.935 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:36:31.935 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:36:31.936 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:36:31.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2021-07-26T15:36:31.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-07-26T15:36:31.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-07-26T15:36:31.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:36:31.971 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:36:31.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-07-26T15:36:32.029 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:32.030 INFO:tasks.ceph:role: c1.osd.1 2021-07-26T15:36:32.030 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:36:32.031 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-07-26T15:36:32.074 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:36:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:36:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:36:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 2021-07-26T15:36:32.075 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:36:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:36:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:36:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:36:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:36:32.076 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:36:32.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2021-07-26T15:36:32.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-07-26T15:36:32.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-07-26T15:36:32.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:36:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:36:32.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-07-26T15:36:32.169 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:32.170 INFO:tasks.ceph:role: c1.osd.2 2021-07-26T15:36:32.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:36:32.170 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-07-26T15:36:32.255 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:36:32.256 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:36:32.256 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:36:32.256 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 2021-07-26T15:36:32.256 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:36:32.257 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:36:32.257 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:36:32.257 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:36:32.257 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:36:32.258 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:36:32.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2021-07-26T15:36:32.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-07-26T15:36:32.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-07-26T15:36:32.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:36:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:36:32.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:32.368 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:32.364+0000 7fadacebbf00 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-07-26T15:36:32.369 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:32.364+0000 7fadacebbf00 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-07-26T15:36:32.369 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:32.364+0000 7fadacebbf00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:36:32.369 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:32.364+0000 7fadacebbf00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:36:32.369 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:32.364+0000 7fadacebbf00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:36:32.370 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:32.364+0000 7fadacebbf00 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-07-26T15:36:34.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-07-26T15:36:34.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:34.604 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:34.600+0000 7fb8a686af00 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-07-26T15:36:34.605 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:34.600+0000 7fb8a686af00 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-07-26T15:36:34.605 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:34.600+0000 7fb8a686af00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:36:34.605 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:34.600+0000 7fb8a686af00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:36:34.605 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:34.600+0000 7fb8a686af00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:36:34.606 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:34.604+0000 7fb8a686af00 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-07-26T15:36:36.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-07-26T15:36:36.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:36.843 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:36.840+0000 7fa8ad865f00 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-07-26T15:36:36.843 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:36.840+0000 7fa8ad865f00 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-07-26T15:36:36.843 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:36.840+0000 7fa8ad865f00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:36:36.843 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:36.840+0000 7fa8ad865f00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:36:36.844 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:36.840+0000 7fa8ad865f00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:36:36.844 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:36:36.840+0000 7fa8ad865f00 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-07-26T15:36:39.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-07-26T15:36:39.077 INFO:tasks.ceph:Reading keys from all nodes... 2021-07-26T15:36:39.077 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:39.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2021-07-26T15:36:39.089 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:39.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2021-07-26T15:36:39.157 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:39.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2021-07-26T15:36:39.177 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:39.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2021-07-26T15:36:39.205 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:39.205 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2021-07-26T15:36:39.261 INFO:tasks.ceph:Adding keys to all mons... 2021-07-26T15:36:39.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/c1.keyring 2021-07-26T15:36:39.278 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2021-07-26T15:36:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB/1v5ghVvzKxAAZeVEoNIkmhqpTOgLODzh8A== 2021-07-26T15:36:39.278 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2021-07-26T15:36:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCA1v5giiIMFhAAfsCg/rrDjx/qUOkrvS4lBw== 2021-07-26T15:36:39.279 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2021-07-26T15:36:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCC1v5gvmMiJBAAAZVOl8/dzHb5C1ijJmEoRg== 2021-07-26T15:36:39.279 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2021-07-26T15:36:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCE1v5gvLlSMhAANpOB8tRJ7AsvU8qtc8iVBA== 2021-07-26T15:36:39.280 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2021-07-26T15:36:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB/1v5gWx/PMBAAUEhdt3i6Sak1fsZK5NZdzQ== 2021-07-26T15:36:39.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-07-26T15:36:39.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:36:39.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:36:39.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:36:39.546 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:36:39.587 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-07-26T15:36:39.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-07-26T15:36:39.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-07-26T15:36:39.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-07-26T15:36:39.727 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:36:39.776 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-07-26T15:36:39.776 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-07-26T15:36:39.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-07-26T15:36:39.787 INFO:tasks.ceph.c1.mon.a:Started 2021-07-26T15:36:39.787 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-07-26T15:36:39.788 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-07-26T15:36:39.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-07-26T15:36:39.792 INFO:tasks.ceph.c1.mgr.x:Started 2021-07-26T15:36:39.793 INFO:tasks.ceph:Setting crush tunables to default 2021-07-26T15:36:39.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster c1 osd crush tunables default 2021-07-26T15:36:39.997 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2021-07-26T15:36:40.014 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-07-26T15:36:40.017 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:40.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2021-07-26T15:36:40.033 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:40.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2021-07-26T15:36:40.043 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:40.044 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2021-07-26T15:36:40.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster c1 osd new 79d70022-43dd-43f4-9bbf-28c61db156fb 0 2021-07-26T15:36:40.298 INFO:teuthology.orchestra.run.smithi018.stdout:0 2021-07-26T15:36:40.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster c1 osd new 500356fa-1523-4017-82e2-d0f650bc38cd 1 2021-07-26T15:36:40.491 INFO:teuthology.orchestra.run.smithi018.stdout:1 2021-07-26T15:36:40.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster c1 osd new 92a5aaef-01ce-4f71-8033-8dbcdb26dd24 2 2021-07-26T15:36:40.705 INFO:teuthology.orchestra.run.smithi018.stdout:2 2021-07-26T15:36:40.720 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-07-26T15:36:40.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-07-26T15:36:40.723 INFO:tasks.ceph.c1.osd.0:Started 2021-07-26T15:36:40.724 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-07-26T15:36:40.724 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-07-26T15:36:40.726 INFO:tasks.ceph.c1.osd.1:Started 2021-07-26T15:36:40.727 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-07-26T15:36:40.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-07-26T15:36:40.739 INFO:tasks.ceph.c1.osd.2:Started 2021-07-26T15:36:40.740 INFO:tasks.ceph:Waiting for OSDs to come up 2021-07-26T15:36:41.047 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-07-26T15:36:41.086 INFO:tasks.ceph.c1.osd.1.smithi018.stderr:2021-07-26T15:36:41.080+0000 7fd70cf1af00 -1 Falling back to public interface 2021-07-26T15:36:41.091 INFO:tasks.ceph.c1.osd.0.smithi018.stderr:2021-07-26T15:36:41.088+0000 7f069c221f00 -1 Falling back to public interface 2021-07-26T15:36:41.114 INFO:tasks.ceph.c1.osd.2.smithi018.stderr:2021-07-26T15:36:41.108+0000 7f428d06df00 -1 Falling back to public interface 2021-07-26T15:36:41.228 INFO:teuthology.misc.health.smithi018.stdout: 2021-07-26T15:36:41.229 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":5,"fsid":"ae04df7d-64d2-468a-9ab4-77d4ecc24293","created":"2021-07-26T15:36:39.901292+0000","modified":"2021-07-26T15:36:40.702909+0000","last_up_change":"0.000000","last_in_change":"2021-07-26T15:36:40.702909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"79d70022-43dd-43f4-9bbf-28c61db156fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"500356fa-1523-4017-82e2-d0f650bc38cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"92a5aaef-01ce-4f71-8033-8dbcdb26dd24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:36:41.235 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-07-26T15:36:43.913 INFO:tasks.ceph.c1.osd.0.smithi018.stderr:2021-07-26T15:36:43.912+0000 7f069c221f00 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:36:44.112 INFO:tasks.ceph.c1.osd.1.smithi018.stderr:2021-07-26T15:36:44.108+0000 7fd70cf1af00 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:36:44.184 INFO:tasks.ceph.c1.osd.2.smithi018.stderr:2021-07-26T15:36:44.180+0000 7f428d06df00 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:36:45.665 INFO:tasks.ceph.c1.osd.1.smithi018.stderr:2021-07-26T15:36:45.664+0000 7fd7086bc700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:36:45.666 INFO:tasks.ceph.c1.osd.0.smithi018.stderr:2021-07-26T15:36:45.664+0000 7f06979c3700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:36:45.667 INFO:tasks.ceph.c1.osd.2.smithi018.stderr:2021-07-26T15:36:45.664+0000 7f428880f700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:36:47.539 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-07-26T15:36:47.799 INFO:teuthology.misc.health.smithi018.stdout: 2021-07-26T15:36:47.800 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":9,"fsid":"ae04df7d-64d2-468a-9ab4-77d4ecc24293","created":"2021-07-26T15:36:39.901292+0000","modified":"2021-07-26T15:36:47.666493+0000","last_up_change":"2021-07-26T15:36:46.657701+0000","last_in_change":"2021-07-26T15:36:40.702909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:46.739337+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"79d70022-43dd-43f4-9bbf-28c61db156fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":16216},{"type":"v1","addr":"172.21.15.18:6809","nonce":16216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":16216},{"type":"v1","addr":"172.21.15.18:6811","nonce":16216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":16216},{"type":"v1","addr":"172.21.15.18:6815","nonce":16216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":16216},{"type":"v1","addr":"172.21.15.18:6813","nonce":16216}]},"public_addr":"172.21.15.18:6809/16216","cluster_addr":"172.21.15.18:6811/16216","heartbeat_back_addr":"172.21.15.18:6815/16216","heartbeat_front_addr":"172.21.15.18:6813/16216","state":["exists","up"]},{"osd":1,"uuid":"500356fa-1523-4017-82e2-d0f650bc38cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":16215},{"type":"v1","addr":"172.21.15.18:6801","nonce":16215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":16215},{"type":"v1","addr":"172.21.15.18:6803","nonce":16215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":16215},{"type":"v1","addr":"172.21.15.18:6807","nonce":16215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":16215},{"type":"v1","addr":"172.21.15.18:6805","nonce":16215}]},"public_addr":"172.21.15.18:6801/16215","cluster_addr":"172.21.15.18:6803/16215","heartbeat_back_addr":"172.21.15.18:6807/16215","heartbeat_front_addr":"172.21.15.18:6805/16215","state":["exists","up"]},{"osd":2,"uuid":"92a5aaef-01ce-4f71-8033-8dbcdb26dd24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":16217},{"type":"v1","addr":"172.21.15.18:6817","nonce":16217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":16217},{"type":"v1","addr":"172.21.15.18:6819","nonce":16217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":16217},{"type":"v1","addr":"172.21.15.18:6823","nonce":16217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":16217},{"type":"v1","addr":"172.21.15.18:6821","nonce":16217}]},"public_addr":"172.21.15.18:6817/16217","cluster_addr":"172.21.15.18:6819/16217","heartbeat_back_addr":"172.21.15.18:6823/16217","heartbeat_front_addr":"172.21.15.18:6821/16217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:44.967556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.142908+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.187749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:36:47.811 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-07-26T15:36:47.812 INFO:tasks.ceph:Creating RBD pool 2021-07-26T15:36:47.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster c1 osd pool create rbd 8 2021-07-26T15:36:48.686 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'rbd' created 2021-07-26T15:36:48.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:36:49.702 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:36:49.712 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-07-26T15:36:49.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:36:49.714 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-07-26T15:36:49.989 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:49.989 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":11,"fsid":"ae04df7d-64d2-468a-9ab4-77d4ecc24293","created":"2021-07-26T15:36:39.901292+0000","modified":"2021-07-26T15:36:49.681037+0000","last_up_change":"2021-07-26T15:36:46.657701+0000","last_in_change":"2021-07-26T15:36:40.702909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:46.739337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:36:48.148040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"79d70022-43dd-43f4-9bbf-28c61db156fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":16216},{"type":"v1","addr":"172.21.15.18:6809","nonce":16216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":16216},{"type":"v1","addr":"172.21.15.18:6811","nonce":16216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":16216},{"type":"v1","addr":"172.21.15.18:6815","nonce":16216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":16216},{"type":"v1","addr":"172.21.15.18:6813","nonce":16216}]},"public_addr":"172.21.15.18:6809/16216","cluster_addr":"172.21.15.18:6811/16216","heartbeat_back_addr":"172.21.15.18:6815/16216","heartbeat_front_addr":"172.21.15.18:6813/16216","state":["exists","up"]},{"osd":1,"uuid":"500356fa-1523-4017-82e2-d0f650bc38cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":16215},{"type":"v1","addr":"172.21.15.18:6801","nonce":16215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":16215},{"type":"v1","addr":"172.21.15.18:6803","nonce":16215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":16215},{"type":"v1","addr":"172.21.15.18:6807","nonce":16215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":16215},{"type":"v1","addr":"172.21.15.18:6805","nonce":16215}]},"public_addr":"172.21.15.18:6801/16215","cluster_addr":"172.21.15.18:6803/16215","heartbeat_back_addr":"172.21.15.18:6807/16215","heartbeat_front_addr":"172.21.15.18:6805/16215","state":["exists","up"]},{"osd":2,"uuid":"92a5aaef-01ce-4f71-8033-8dbcdb26dd24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":16217},{"type":"v1","addr":"172.21.15.18:6817","nonce":16217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":16217},{"type":"v1","addr":"172.21.15.18:6819","nonce":16217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":16217},{"type":"v1","addr":"172.21.15.18:6823","nonce":16217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":16217},{"type":"v1","addr":"172.21.15.18:6821","nonce":16217}]},"public_addr":"172.21.15.18:6817/16217","cluster_addr":"172.21.15.18:6819/16217","heartbeat_back_addr":"172.21.15.18:6823/16217","heartbeat_front_addr":"172.21.15.18:6821/16217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:44.967556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.142908+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.187749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:36:50.007 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:36:46.739337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:36:48.148040+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:36:50.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get device_health_metrics pg_num 2021-07-26T15:36:50.277 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2021-07-26T15:36:50.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get rbd pg_num 2021-07-26T15:36:50.575 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2021-07-26T15:36:50.588 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-07-26T15:36:50.589 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-07-26T15:36:50.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2021-07-26T15:36:50.896 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:50.908 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":16032},{"type":"v1","addr":"172.21.15.18:6825","nonce":16032}]},"active_addr":"172.21.15.18:6825/16032","active_change":"2021-07-26T15:36:43.592438+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3941643524}]},{"addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2743866395}]}]}} 2021-07-26T15:36:50.911 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-07-26T15:36:50.911 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2021-07-26T15:36:50.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:36:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:51.178 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":12,"fsid":"ae04df7d-64d2-468a-9ab4-77d4ecc24293","created":"2021-07-26T15:36:39.901292+0000","modified":"2021-07-26T15:36:50.687430+0000","last_up_change":"2021-07-26T15:36:46.657701+0000","last_in_change":"2021-07-26T15:36:40.702909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:46.739337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:36:48.148040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"79d70022-43dd-43f4-9bbf-28c61db156fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":16216},{"type":"v1","addr":"172.21.15.18:6809","nonce":16216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":16216},{"type":"v1","addr":"172.21.15.18:6811","nonce":16216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":16216},{"type":"v1","addr":"172.21.15.18:6815","nonce":16216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":16216},{"type":"v1","addr":"172.21.15.18:6813","nonce":16216}]},"public_addr":"172.21.15.18:6809/16216","cluster_addr":"172.21.15.18:6811/16216","heartbeat_back_addr":"172.21.15.18:6815/16216","heartbeat_front_addr":"172.21.15.18:6813/16216","state":["exists","up"]},{"osd":1,"uuid":"500356fa-1523-4017-82e2-d0f650bc38cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":16215},{"type":"v1","addr":"172.21.15.18:6801","nonce":16215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":16215},{"type":"v1","addr":"172.21.15.18:6803","nonce":16215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":16215},{"type":"v1","addr":"172.21.15.18:6807","nonce":16215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":16215},{"type":"v1","addr":"172.21.15.18:6805","nonce":16215}]},"public_addr":"172.21.15.18:6801/16215","cluster_addr":"172.21.15.18:6803/16215","heartbeat_back_addr":"172.21.15.18:6807/16215","heartbeat_front_addr":"172.21.15.18:6805/16215","state":["exists","up"]},{"osd":2,"uuid":"92a5aaef-01ce-4f71-8033-8dbcdb26dd24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":16217},{"type":"v1","addr":"172.21.15.18:6817","nonce":16217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":16217},{"type":"v1","addr":"172.21.15.18:6819","nonce":16217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":16217},{"type":"v1","addr":"172.21.15.18:6823","nonce":16217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":16217},{"type":"v1","addr":"172.21.15.18:6821","nonce":16217}]},"public_addr":"172.21.15.18:6817/16217","cluster_addr":"172.21.15.18:6819/16217","heartbeat_back_addr":"172.21.15.18:6823/16217","heartbeat_front_addr":"172.21.15.18:6821/16217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:44.967556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.142908+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.187749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:36:51.191 INFO:tasks.ceph.ceph_manager.c1:all up! 2021-07-26T15:36:51.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:36:51.448 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:51.448 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":12,"fsid":"ae04df7d-64d2-468a-9ab4-77d4ecc24293","created":"2021-07-26T15:36:39.901292+0000","modified":"2021-07-26T15:36:50.687430+0000","last_up_change":"2021-07-26T15:36:46.657701+0000","last_in_change":"2021-07-26T15:36:40.702909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:46.739337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:36:48.148040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"79d70022-43dd-43f4-9bbf-28c61db156fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":16216},{"type":"v1","addr":"172.21.15.18:6809","nonce":16216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":16216},{"type":"v1","addr":"172.21.15.18:6811","nonce":16216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":16216},{"type":"v1","addr":"172.21.15.18:6815","nonce":16216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":16216},{"type":"v1","addr":"172.21.15.18:6813","nonce":16216}]},"public_addr":"172.21.15.18:6809/16216","cluster_addr":"172.21.15.18:6811/16216","heartbeat_back_addr":"172.21.15.18:6815/16216","heartbeat_front_addr":"172.21.15.18:6813/16216","state":["exists","up"]},{"osd":1,"uuid":"500356fa-1523-4017-82e2-d0f650bc38cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":16215},{"type":"v1","addr":"172.21.15.18:6801","nonce":16215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":16215},{"type":"v1","addr":"172.21.15.18:6803","nonce":16215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":16215},{"type":"v1","addr":"172.21.15.18:6807","nonce":16215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":16215},{"type":"v1","addr":"172.21.15.18:6805","nonce":16215}]},"public_addr":"172.21.15.18:6801/16215","cluster_addr":"172.21.15.18:6803/16215","heartbeat_back_addr":"172.21.15.18:6807/16215","heartbeat_front_addr":"172.21.15.18:6805/16215","state":["exists","up"]},{"osd":2,"uuid":"92a5aaef-01ce-4f71-8033-8dbcdb26dd24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":16217},{"type":"v1","addr":"172.21.15.18:6817","nonce":16217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":16217},{"type":"v1","addr":"172.21.15.18:6819","nonce":16217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":16217},{"type":"v1","addr":"172.21.15.18:6823","nonce":16217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":16217},{"type":"v1","addr":"172.21.15.18:6821","nonce":16217}]},"public_addr":"172.21.15.18:6817/16217","cluster_addr":"172.21.15.18:6819/16217","heartbeat_back_addr":"172.21.15.18:6823/16217","heartbeat_front_addr":"172.21.15.18:6821/16217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:44.967556+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.142908+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:45.187749+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:36:51.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-07-26T15:36:51.606 INFO:teuthology.orchestra.run.smithi018.stdout:34359738371 2021-07-26T15:36:51.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-07-26T15:36:51.760 INFO:teuthology.orchestra.run.smithi018.stdout:34359738371 2021-07-26T15:36:51.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-07-26T15:36:51.914 INFO:teuthology.orchestra.run.smithi018.stdout:34359738371 2021-07-26T15:36:51.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-07-26T15:36:52.177 INFO:teuthology.orchestra.run.smithi018.stdout:34359738371 2021-07-26T15:36:52.190 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.0 2021-07-26T15:36:52.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2021-07-26T15:36:52.458 INFO:teuthology.orchestra.run.smithi018.stdout:34359738369 2021-07-26T15:36:52.470 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738369 for osd.1 2021-07-26T15:36:53.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2021-07-26T15:36:53.755 INFO:teuthology.orchestra.run.smithi018.stdout:34359738371 2021-07-26T15:36:53.768 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.1 2021-07-26T15:36:53.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2021-07-26T15:36:54.040 INFO:teuthology.orchestra.run.smithi018.stdout:34359738371 2021-07-26T15:36:54.054 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.2 2021-07-26T15:36:54.054 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-07-26T15:36:54.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-07-26T15:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:54.313 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2021-07-26T15:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-07-26T15:36:53.600903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14664,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558136,"statfs":{"total":322122547200,"available":322107531264,"internally_reserved":0,"allocated":311296,"data_stored":83847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.700482+0000","last_change":"2021-07-26T15:36:49.700482+0000","last_active":"2021-07-26T15:36:49.700482+0000","last_peered":"2021-07-26T15:36:49.700482+0000","last_clean":"2021-07-26T15:36:49.700482+0000","last_became_active":"2021-07-26T15:36:49.700117+0000","last_became_peered":"2021-07-26T15:36:49.700117+0000","last_unstale":"2021-07-26T15:36:49.700482+0000","last_undegraded":"2021-07-26T15:36:49.700482+0000","last_fullsized":"2021-07-26T15:36:49.700482+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.702272+0000","last_change":"2021-07-26T15:36:49.702272+0000","last_active":"2021-07-26T15:36:49.702272+0000","last_peered":"2021-07-26T15:36:49.702272+0000","last_clean":"2021-07-26T15:36:49.702272+0000","last_became_active":"2021-07-26T15:36:49.702063+0000","last_became_peered":"2021-07-26T15:36:49.702063+0000","last_unstale":"2021-07-26T15:36:49.702272+0000","last_undegraded":"2021-07-26T15:36:49.702272+0000","last_fullsized":"2021-07-26T15:36:49.702272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.700581+0000","last_change":"2021-07-26T15:36:49.700581+0000","last_active":"2021-07-26T15:36:49.700581+0000","last_peered":"2021-07-26T15:36:49.700581+0000","last_clean":"2021-07-26T15:36:49.700581+0000","last_became_active":"2021-07-26T15:36:49.700174+0000","last_became_peered":"2021-07-26T15:36:49.700174+0000","last_unstale":"2021-07-26T15:36:49.700581+0000","last_undegraded":"2021-07-26T15:36:49.700581+0000","last_fullsized":"2021-07-26T15:36:49.700581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.700774+0000","last_change":"2021-07-26T15:36:49.700774+0000","last_active":"2021-07-26T15:36:49.700774+0000","last_peered":"2021-07-26T15:36:49.700774+0000","last_clean":"2021-07-26T15:36:49.700774+0000","last_became_active":"2021-07-26T15:36:49.700468+0000","last_became_peered":"2021-07-26T15:36:49.700468+0000","last_unstale":"2021-07-26T15:36:49.700774+0000","last_undegraded":"2021-07-26T15:36:49.700774+0000","last_fullsized":"2021-07-26T15:36:49.700774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.701789+0000","last_change":"2021-07-26T15:36:49.700755+0000","last_active":"2021-07-26T15:36:49.701789+0000","last_peered":"2021-07-26T15:36:49.701789+0000","last_clean":"2021-07-26T15:36:49.701789+0000","last_became_active":"2021-07-26T15:36:49.700447+0000","last_became_peered":"2021-07-26T15:36:49.700447+0000","last_unstale":"2021-07-26T15:36:49.701789+0000","last_undegraded":"2021-07-26T15:36:49.701789+0000","last_fullsized":"2021-07-26T15:36:49.701789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.701890+0000","last_change":"2021-07-26T15:36:49.700037+0000","last_active":"2021-07-26T15:36:49.701890+0000","last_peered":"2021-07-26T15:36:49.701890+0000","last_clean":"2021-07-26T15:36:49.701890+0000","last_became_active":"2021-07-26T15:36:49.699666+0000","last_became_peered":"2021-07-26T15:36:49.699666+0000","last_unstale":"2021-07-26T15:36:49.701890+0000","last_undegraded":"2021-07-26T15:36:49.701890+0000","last_fullsized":"2021-07-26T15:36:49.701890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.701691+0000","last_change":"2021-07-26T15:36:49.699828+0000","last_active":"2021-07-26T15:36:49.701691+0000","last_peered":"2021-07-26T15:36:49.701691+0000","last_clean":"2021-07-26T15:36:49.701691+0000","last_became_active":"2021-07-26T15:36:49.699426+0000","last_became_peered":"2021-07-26T15:36:49.699426+0000","last_unstale":"2021-07-26T15:36:49.701691+0000","last_undegraded":"2021-07-26T15:36:49.701691+0000","last_fullsized":"2021-07-26T15:36:49.701691+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.698821+0000","last_change":"2021-07-26T15:36:49.698821+0000","last_active":"2021-07-26T15:36:49.698821+0000","last_peered":"2021-07-26T15:36:49.698821+0000","last_clean":"2021-07-26T15:36:49.698821+0000","last_became_active":"2021-07-26T15:36:49.698296+0000","last_became_peered":"2021-07-26T15:36:49.698296+0000","last_unstale":"2021-07-26T15:36:49.698821+0000","last_undegraded":"2021-07-26T15:36:49.698821+0000","last_fullsized":"2021-07-26T15:36:49.698821+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-07-26T15:36:48.687985+0000","last_change":"2021-07-26T15:36:48.687320+0000","last_active":"2021-07-26T15:36:48.687985+0000","last_peered":"2021-07-26T15:36:48.687985+0000","last_clean":"2021-07-26T15:36:48.687985+0000","last_became_active":"2021-07-26T15:36:48.686965+0000","last_became_peered":"2021-07-26T15:36:48.686965+0000","last_unstale":"2021-07-26T15:36:48.687985+0000","last_undegraded":"2021-07-26T15:36:48.687985+0000","last_fullsized":"2021-07-26T15:36:48.687985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:47.666493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:47.666493+0000","last_clean_scrub_stamp":"2021-07-26T15:36:47.666493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4848,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852752,"statfs":{"total":107374182400,"available":107369218048,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4904,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852696,"statfs":{"total":107374182400,"available":107369160704,"internally_reserved":0,"allocated":98304,"data_stored":25629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T15:36:54.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-07-26T15:36:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:54.588 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2021-07-26T15:36:54.598 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-07-26T15:36:53.600903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14664,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558136,"statfs":{"total":322122547200,"available":322107531264,"internally_reserved":0,"allocated":311296,"data_stored":83847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.700482+0000","last_change":"2021-07-26T15:36:49.700482+0000","last_active":"2021-07-26T15:36:49.700482+0000","last_peered":"2021-07-26T15:36:49.700482+0000","last_clean":"2021-07-26T15:36:49.700482+0000","last_became_active":"2021-07-26T15:36:49.700117+0000","last_became_peered":"2021-07-26T15:36:49.700117+0000","last_unstale":"2021-07-26T15:36:49.700482+0000","last_undegraded":"2021-07-26T15:36:49.700482+0000","last_fullsized":"2021-07-26T15:36:49.700482+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.702272+0000","last_change":"2021-07-26T15:36:49.702272+0000","last_active":"2021-07-26T15:36:49.702272+0000","last_peered":"2021-07-26T15:36:49.702272+0000","last_clean":"2021-07-26T15:36:49.702272+0000","last_became_active":"2021-07-26T15:36:49.702063+0000","last_became_peered":"2021-07-26T15:36:49.702063+0000","last_unstale":"2021-07-26T15:36:49.702272+0000","last_undegraded":"2021-07-26T15:36:49.702272+0000","last_fullsized":"2021-07-26T15:36:49.702272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.700581+0000","last_change":"2021-07-26T15:36:49.700581+0000","last_active":"2021-07-26T15:36:49.700581+0000","last_peered":"2021-07-26T15:36:49.700581+0000","last_clean":"2021-07-26T15:36:49.700581+0000","last_became_active":"2021-07-26T15:36:49.700174+0000","last_became_peered":"2021-07-26T15:36:49.700174+0000","last_unstale":"2021-07-26T15:36:49.700581+0000","last_undegraded":"2021-07-26T15:36:49.700581+0000","last_fullsized":"2021-07-26T15:36:49.700581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.700774+0000","last_change":"2021-07-26T15:36:49.700774+0000","last_active":"2021-07-26T15:36:49.700774+0000","last_peered":"2021-07-26T15:36:49.700774+0000","last_clean":"2021-07-26T15:36:49.700774+0000","last_became_active":"2021-07-26T15:36:49.700468+0000","last_became_peered":"2021-07-26T15:36:49.700468+0000","last_unstale":"2021-07-26T15:36:49.700774+0000","last_undegraded":"2021-07-26T15:36:49.700774+0000","last_fullsized":"2021-07-26T15:36:49.700774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.701789+0000","last_change":"2021-07-26T15:36:49.700755+0000","last_active":"2021-07-26T15:36:49.701789+0000","last_peered":"2021-07-26T15:36:49.701789+0000","last_clean":"2021-07-26T15:36:49.701789+0000","last_became_active":"2021-07-26T15:36:49.700447+0000","last_became_peered":"2021-07-26T15:36:49.700447+0000","last_unstale":"2021-07-26T15:36:49.701789+0000","last_undegraded":"2021-07-26T15:36:49.701789+0000","last_fullsized":"2021-07-26T15:36:49.701789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.701890+0000","last_change":"2021-07-26T15:36:49.700037+0000","last_active":"2021-07-26T15:36:49.701890+0000","last_peered":"2021-07-26T15:36:49.701890+0000","last_clean":"2021-07-26T15:36:49.701890+0000","last_became_active":"2021-07-26T15:36:49.699666+0000","last_became_peered":"2021-07-26T15:36:49.699666+0000","last_unstale":"2021-07-26T15:36:49.701890+0000","last_undegraded":"2021-07-26T15:36:49.701890+0000","last_fullsized":"2021-07-26T15:36:49.701890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.701691+0000","last_change":"2021-07-26T15:36:49.699828+0000","last_active":"2021-07-26T15:36:49.701691+0000","last_peered":"2021-07-26T15:36:49.701691+0000","last_clean":"2021-07-26T15:36:49.701691+0000","last_became_active":"2021-07-26T15:36:49.699426+0000","last_became_peered":"2021-07-26T15:36:49.699426+0000","last_unstale":"2021-07-26T15:36:49.701691+0000","last_undegraded":"2021-07-26T15:36:49.701691+0000","last_fullsized":"2021-07-26T15:36:49.701691+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:36:49.698821+0000","last_change":"2021-07-26T15:36:49.698821+0000","last_active":"2021-07-26T15:36:49.698821+0000","last_peered":"2021-07-26T15:36:49.698821+0000","last_clean":"2021-07-26T15:36:49.698821+0000","last_became_active":"2021-07-26T15:36:49.698296+0000","last_became_peered":"2021-07-26T15:36:49.698296+0000","last_unstale":"2021-07-26T15:36:49.698821+0000","last_undegraded":"2021-07-26T15:36:49.698821+0000","last_fullsized":"2021-07-26T15:36:49.698821+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:48.671177+0000","last_clean_scrub_stamp":"2021-07-26T15:36:48.671177+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-07-26T15:36:48.687985+0000","last_change":"2021-07-26T15:36:48.687320+0000","last_active":"2021-07-26T15:36:48.687985+0000","last_peered":"2021-07-26T15:36:48.687985+0000","last_clean":"2021-07-26T15:36:48.687985+0000","last_became_active":"2021-07-26T15:36:48.686965+0000","last_became_peered":"2021-07-26T15:36:48.686965+0000","last_unstale":"2021-07-26T15:36:48.687985+0000","last_undegraded":"2021-07-26T15:36:48.687985+0000","last_fullsized":"2021-07-26T15:36:48.687985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:47.666493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:47.666493+0000","last_clean_scrub_stamp":"2021-07-26T15:36:47.666493+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4848,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852752,"statfs":{"total":107374182400,"available":107369218048,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4904,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852696,"statfs":{"total":107374182400,"available":107369160704,"internally_reserved":0,"allocated":98304,"data_stored":25629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T15:36:54.600 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-07-26T15:36:54.600 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-07-26T15:36:54.600 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2021-07-26T15:36:54.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2021-07-26T15:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:36:54.920 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2021-07-26T15:36:54.921 INFO:teuthology.run_tasks:Running task ceph... 2021-07-26T15:36:54.932 INFO:tasks.ceph:Creating ceph cluster c2... 2021-07-26T15:36:54.932 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-07-26T15:36:54.933 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293838', 'branch': 'wip-kefu-testing-2021-07-24-1158', 'description': 'upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm supported-random-distro$/{ubuntu_latest} tasks upgrade/primary}', 'email': None, 'first_in_suite': False, 'job_id': '6293838', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi', 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-07-24-1158'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'pacific', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-kefu-testing-2021-07-24-1158', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'sleep_before_teardown': 0, 'suite': 'upgrade', 'suite_branch': 'wip-kefu-testing-2021-07-24-1158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'targets': {'smithi018.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mYLgQHG+4OHtOpcPVGk/r6+FAwkPgBjs5qMoPlQVe3igdN/iHazC9qWmzv7WDD+Iyx0KFs23aPBlseCDS67/RiXcbvgiyMWGUDjPT1aubQppJiiPgN1bjfBIoVDWVt6GT7y28EpV2bz5vOlMwKPo6K96sBaCWUwAAIwFPGZtxum82gLOnVyqvLVwPqNfUhY4YtkalF4/3SeTwqFYnyz1ZbsmQO+fhIdO3Zb0dotSb1/XhF/CqRCmtL2+4KoMPww7nEypzs2YqkvYZo4YqP5fn1qqjQ9y9pBUyRFga9rS5PpINWBx0mBo6rCxhTWVkEMLTbDR+uYH4M+mm1538Lf/xZZQ4ZVOJA90VomPgkgqVBPfuXtBjMe9/DkHFk2VTHCdBRX2HW+8P2NlOyayVJqmnps9zfT8XpI9V6ce+ptMkFWWZE59ORl31s8xLnWZH0ZsmpMHBIUUeRkmPM3iQhgxkSL8enD4wHOtZimtUqfoKkmRqGBa97PagzOLBWrtvns=', 'smithi111.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzSKexTFHqtNZ7AxtWSSinQgeX1iKzjFCnKS4MNtilyXBe/u5uaC6Jo9NYwc33XacM0VOwG4gYlijpR5Eg5mwBflSQ/8b+Y8xNdamO1JjyMwftdcfzoTTO9aRZUkaCODx4TZTK01INqeBvMtJR/kzYg4rSH5NBxvCN8uHlOY5PKLU8FA9Y8qJuQbT2rTWp7+MHKNzzCxq0e1sDQ1EdiJvYfJKKmhHIDuO5E1q0t6B1teubqxJ6DkkUwCfSahA7GT43rFObI09WHnf08FcJY6TkPp0FcQXJwXYqTqLqd1etA4M2YvjOQJcVrAxcE2X0Dhe/d2qmcmbIGInRe7UXTEeJ3TMlxf87aFsRvXu+Czq/q2mflWiTQUYUB2OTVK5GEKUdh1EfRchd0OUtZsQ9AJj+YDXvMMLqc7tLXV5Vqfb0mWtysQJKs1CdIrragi2Lalm86/ncNGI+e5dTgdWm5B99mMunH2+mgh9ZMHONj3JYey5y+newLVeLPxu8pAFt/J8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b6f3efab84b70e18e86ec271a07564aeb4ed3bac', 'timestamp': '2021-07-26_15:05:01', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-07-26T15:36:54.933 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-07-26T15:36:54.936 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-07-26T15:36:54.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:36:54.986 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:36:55.010 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:55.011 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:36:55.061 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:36:55.061 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:36:55.069 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:36:55.069 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:55.069 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 345 Links: 1 2021-07-26T15:36:55.069 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:55.070 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2021-07-26 15:33:41.075286838 +0000 2021-07-26T15:36:55.070 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2021-07-26 15:33:40.887286840 +0000 2021-07-26T15:36:55.070 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2021-07-26 15:33:40.887286840 +0000 2021-07-26T15:36:55.070 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2021-07-26T15:36:55.080 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2021-07-26T15:36:55.081 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2021-07-26T15:36:55.081 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000410876 s, 1.2 MB/s 2021-07-26T15:36:55.085 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:36:55.141 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:36:55.142 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:55.142 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-07-26T15:36:55.142 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:55.143 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2021-07-26 15:33:41.471286833 +0000 2021-07-26T15:36:55.143 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2021-07-26 15:33:41.303286835 +0000 2021-07-26T15:36:55.143 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2021-07-26 15:33:41.303286835 +0000 2021-07-26T15:36:55.143 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2021-07-26T15:36:55.152 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2021-07-26T15:36:55.153 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2021-07-26T15:36:55.153 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.00038868 s, 1.3 MB/s 2021-07-26T15:36:55.158 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:36:55.166 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:36:55.166 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:55.167 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 357 Links: 1 2021-07-26T15:36:55.167 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:55.167 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2021-07-26 15:33:41.827286829 +0000 2021-07-26T15:36:55.167 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2021-07-26 15:33:41.695286831 +0000 2021-07-26T15:36:55.168 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2021-07-26 15:33:41.695286831 +0000 2021-07-26T15:36:55.168 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2021-07-26T15:36:55.175 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2021-07-26T15:36:55.176 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2021-07-26T15:36:55.176 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.00036198 s, 1.4 MB/s 2021-07-26T15:36:55.179 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:36:55.230 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:36:55.231 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:36:55.231 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-07-26T15:36:55.231 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:36:55.231 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2021-07-26 15:33:42.255286825 +0000 2021-07-26T15:36:55.232 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2021-07-26 15:33:42.083286827 +0000 2021-07-26T15:36:55.232 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2021-07-26 15:33:42.083286827 +0000 2021-07-26T15:36:55.232 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2021-07-26T15:36:55.240 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2021-07-26T15:36:55.240 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2021-07-26T15:36:55.241 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000389727 s, 1.3 MB/s 2021-07-26T15:36:55.245 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:55.245 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:36:55.246 INFO:tasks.ceph:Generating config... 2021-07-26T15:36:55.247 INFO:tasks.ceph:[client] debug rgw = 20 2021-07-26T15:36:55.248 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-07-26T15:36:55.248 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-07-26T15:36:55.248 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:36:55.249 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-07-26T15:36:55.249 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-07-26T15:36:55.249 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-07-26T15:36:55.250 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-07-26T15:36:55.250 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-07-26T15:36:55.250 INFO:tasks.ceph:[client] setgroup = ceph 2021-07-26T15:36:55.251 INFO:tasks.ceph:[client] setuser = ceph 2021-07-26T15:36:55.251 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-07-26T15:36:55.251 INFO:tasks.ceph:[mgr] debug ms = 1 2021-07-26T15:36:55.251 INFO:tasks.ceph:[mon] debug mon = 20 2021-07-26T15:36:55.252 INFO:tasks.ceph:[mon] debug ms = 1 2021-07-26T15:36:55.252 INFO:tasks.ceph:[mon] debug paxos = 20 2021-07-26T15:36:55.252 INFO:tasks.ceph:[osd] debug ms = 1 2021-07-26T15:36:55.253 INFO:tasks.ceph:[osd] debug osd = 20 2021-07-26T15:36:55.253 INFO:tasks.ceph:Setting up c2.mon.a... 2021-07-26T15:36:55.253 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-07-26T15:36:55.300 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/c2.keyring 2021-07-26T15:36:55.303 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-07-26T15:36:55.339 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:36:55.398 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.111')] 2021-07-26T15:36:55.399 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.111'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-07-26T15:36:55.401 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:55.401 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:36:55.408 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.111 --print /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:36:55.482 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:55.483 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:55.484 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:36:55.484 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: generated fsid 667ba9a6-fbaa-4385-ace9-15df3bbe4d9e 2021-07-26T15:36:55.484 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 0 2021-07-26T15:36:55.484 INFO:teuthology.orchestra.run.smithi111.stdout:fsid 667ba9a6-fbaa-4385-ace9-15df3bbe4d9e 2021-07-26T15:36:55.485 INFO:teuthology.orchestra.run.smithi111.stdout:last_changed 2021-07-26T15:36:55.485525+0000 2021-07-26T15:36:55.485 INFO:teuthology.orchestra.run.smithi111.stdout:created 2021-07-26T15:36:55.485525+0000 2021-07-26T15:36:55.485 INFO:teuthology.orchestra.run.smithi111.stdout:min_mon_release 0 (unknown) 2021-07-26T15:36:55.485 INFO:teuthology.orchestra.run.smithi111.stdout:election_strategy: 1 2021-07-26T15:36:55.486 INFO:teuthology.orchestra.run.smithi111.stdout:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2021-07-26T15:36:55.487 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-07-26T15:36:55.487 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:36:55.493 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 667ba9a6-fbaa-4385-ace9-15df3bbe4d9e... 2021-07-26T15:36:55.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-07-26T15:36:55.496 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-07-26T15:36:55.538 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2021-07-26T15:36:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2021-07-26T15:36:55.540 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:36:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2021-07-26T15:36:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2021-07-26T15:36:55.541 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.542 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2021-07-26T15:36:55.542 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.542 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2021-07-26T15:36:55.542 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2021-07-26T15:36:55.542 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.543 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2021-07-26T15:36:55.543 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2021-07-26T15:36:55.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:36:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2021-07-26T15:36:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:36:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:36:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2021-07-26T15:36:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2021-07-26T15:36:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2021-07-26T15:36:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:36:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:36:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2021-07-26T15:36:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:36:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2021-07-26T15:36:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:36:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:36:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2021-07-26T15:36:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:36:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2021-07-26T15:36:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2021-07-26T15:36:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2021-07-26T15:36:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2021-07-26T15:36:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2021-07-26T15:36:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = 172.21.15.111 2021-07-26T15:36:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 667ba9a6-fbaa-4385-ace9-15df3bbe4d9e 2021-07-26T15:36:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2021-07-26T15:36:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2021-07-26T15:36:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2021-07-26T15:36:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2021-07-26T15:36:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2021-07-26T15:36:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2021-07-26T15:36:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2021-07-26T15:36:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2021-07-26T15:36:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2021-07-26T15:36:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2021-07-26T15:36:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2021-07-26T15:36:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:36:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2021-07-26T15:36:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2021-07-26T15:36:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:36:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2021-07-26T15:36:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2021-07-26T15:36:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2021-07-26T15:36:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2021-07-26T15:36:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2021-07-26T15:36:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.557 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2021-07-26T15:36:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2021-07-26T15:36:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2021-07-26T15:36:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2021-07-26T15:36:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2021-07-26T15:36:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2021-07-26T15:36:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.559 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2021-07-26T15:36:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2021-07-26T15:36:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2021-07-26T15:36:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2021-07-26T15:36:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2021-07-26T15:36:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2021-07-26T15:36:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2021-07-26T15:36:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2021-07-26T15:36:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2021-07-26T15:36:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:36:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:36:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:36:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:36:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-07-26T15:36:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-07-26T15:36:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:36:55.563 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2021-07-26T15:36:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2021-07-26T15:36:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2021-07-26T15:36:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2021-07-26T15:36:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:36:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:36:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: debug rgw = 20 2021-07-26T15:36:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt require ssl = False 2021-07-26T15:36:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:36:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:36:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw curl low speed time = 300 2021-07-26T15:36:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw data log num shards = 4 2021-07-26T15:36:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: rgw md log max shards = 4 2021-07-26T15:36:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: rgw sync log trim interval = 0 2021-07-26T15:36:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: rgw sync obj etag verify = True 2021-07-26T15:36:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: setgroup = ceph 2021-07-26T15:36:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: setuser = ceph 2021-07-26T15:36:55.567 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2021-07-26T15:36:55.568 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2021-07-26T15:36:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2021-07-26T15:36:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:36:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2021-07-26T15:36:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2021-07-26T15:36:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2021-07-26T15:36:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2021-07-26T15:36:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2021-07-26T15:36:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2021-07-26T15:36:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2021-07-26T15:36:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:36:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2021-07-26T15:36:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:36:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:36:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2021-07-26T15:36:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2021-07-26T15:36:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2021-07-26T15:36:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:36:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:36:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2021-07-26T15:36:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:36:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2021-07-26T15:36:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:36:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:36:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2021-07-26T15:36:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:36:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2021-07-26T15:36:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2021-07-26T15:36:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2021-07-26T15:36:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2021-07-26T15:36:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2021-07-26T15:36:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = 172.21.15.111 2021-07-26T15:36:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = 667ba9a6-fbaa-4385-ace9-15df3bbe4d9e 2021-07-26T15:36:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.578 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2021-07-26T15:36:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2021-07-26T15:36:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2021-07-26T15:36:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2021-07-26T15:36:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2021-07-26T15:36:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2021-07-26T15:36:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2021-07-26T15:36:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2021-07-26T15:36:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2021-07-26T15:36:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2021-07-26T15:36:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2021-07-26T15:36:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:36:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2021-07-26T15:36:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.583 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2021-07-26T15:36:55.583 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.583 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:36:55.583 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2021-07-26T15:36:55.584 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.584 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2021-07-26T15:36:55.584 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2021-07-26T15:36:55.584 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2021-07-26T15:36:55.584 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2021-07-26T15:36:55.585 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.585 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2021-07-26T15:36:55.585 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2021-07-26T15:36:55.585 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2021-07-26T15:36:55.586 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2021-07-26T15:36:55.586 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2021-07-26T15:36:55.586 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:55.586 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:55.586 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2021-07-26T15:36:55.587 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.587 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2021-07-26T15:36:55.587 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2021-07-26T15:36:55.587 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2021-07-26T15:36:55.588 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2021-07-26T15:36:55.588 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2021-07-26T15:36:55.588 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2021-07-26T15:36:55.588 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2021-07-26T15:36:55.588 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:36:55.589 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2021-07-26T15:36:55.589 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2021-07-26T15:36:55.589 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:36:55.589 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.589 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:36:55.590 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:36:55.590 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:36:55.590 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.590 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:36:55.591 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-07-26T15:36:55.591 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-07-26T15:36:55.591 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:36:55.591 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2021-07-26T15:36:55.592 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2021-07-26T15:36:55.592 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2021-07-26T15:36:55.592 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2021-07-26T15:36:55.592 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:36:55.592 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:36:55.593 INFO:teuthology.orchestra.run.smithi111.stdout: debug rgw = 20 2021-07-26T15:36:55.593 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt require ssl = False 2021-07-26T15:36:55.593 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:36:55.593 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:36:55.594 INFO:teuthology.orchestra.run.smithi111.stdout: rgw curl low speed time = 300 2021-07-26T15:36:55.594 INFO:teuthology.orchestra.run.smithi111.stdout: rgw data log num shards = 4 2021-07-26T15:36:55.594 INFO:teuthology.orchestra.run.smithi111.stdout: rgw md log max shards = 4 2021-07-26T15:36:55.594 INFO:teuthology.orchestra.run.smithi111.stdout: rgw sync log trim interval = 0 2021-07-26T15:36:55.594 INFO:teuthology.orchestra.run.smithi111.stdout: rgw sync obj etag verify = True 2021-07-26T15:36:55.595 INFO:teuthology.orchestra.run.smithi111.stdout: setgroup = ceph 2021-07-26T15:36:55.595 INFO:teuthology.orchestra.run.smithi111.stdout: setuser = ceph 2021-07-26T15:36:55.595 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2021-07-26T15:36:55.596 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-07-26T15:36:55.597 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-07-26T15:36:55.648 INFO:tasks.ceph:Copying monmap to all nodes... 2021-07-26T15:36:55.649 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:55.651 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2021-07-26T15:36:55.698 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:55.699 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2021-07-26T15:36:55.705 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2021-07-26T15:36:55.706 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:55.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/c2.keyring 2021-07-26T15:36:55.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:36:55.732 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:36:55.733 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-07-26T15:36:55.739 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:36:55.739 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:55.740 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/c2.keyring 2021-07-26T15:36:55.740 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:36:55.767 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:36:55.768 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-07-26T15:36:55.817 INFO:tasks.ceph:Setting up mon nodes... 2021-07-26T15:36:55.818 INFO:tasks.ceph:Setting up mgr nodes... 2021-07-26T15:36:55.818 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-07-26T15:36:55.862 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-07-26T15:36:55.866 INFO:tasks.ceph:Setting up mds nodes... 2021-07-26T15:36:55.866 INFO:tasks.ceph_client:Setting up client nodes... 2021-07-26T15:36:55.867 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-07-26T15:36:55.897 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/c2.client.0.keyring 2021-07-26T15:36:55.909 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-07-26T15:36:55.992 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/c2.client.1.keyring 2021-07-26T15:36:56.003 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-07-26T15:36:56.004 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:36:56.005 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-07-26T15:36:56.019 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:56.019 INFO:tasks.ceph:role: c2.osd.0 2021-07-26T15:36:56.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:36:56.020 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-07-26T15:36:56.594 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:36:56.595 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:36:56.595 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:36:56.595 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 2021-07-26T15:36:56.595 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:36:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:36:56.596 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:36:56.596 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:36:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:36:56.596 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:36:56.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2021-07-26T15:36:56.598 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-07-26T15:36:56.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-07-26T15:36:56.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:36:56.705 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:36:56.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-07-26T15:36:56.764 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:56.764 INFO:tasks.ceph:role: c2.osd.1 2021-07-26T15:36:56.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:36:56.766 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-07-26T15:36:57.266 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:36:57.266 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:36:57.266 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:36:57.266 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 2021-07-26T15:36:57.267 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:36:57.267 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:36:57.267 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:36:57.267 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:36:57.268 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:36:57.268 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:36:57.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2021-07-26T15:36:57.269 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-07-26T15:36:57.310 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-07-26T15:36:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:36:57.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:36:57.364 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-07-26T15:36:57.374 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:36:57.375 INFO:tasks.ceph:role: c2.osd.2 2021-07-26T15:36:57.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2021-07-26T15:36:57.375 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-07-26T15:36:57.840 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:36:57.841 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:36:57.843 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:36:57.843 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 2021-07-26T15:36:57.843 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:36:57.843 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:36:57.844 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:36:57.844 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:36:57.844 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:36:57.844 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:36:57.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2021-07-26T15:36:57.846 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-07-26T15:36:57.904 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-07-26T15:36:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:36:57.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:36:57.918 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:36:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:36:58.013+0000 7fbeeddcff00 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-07-26T15:36:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:36:58.013+0000 7fbeeddcff00 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-07-26T15:36:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:36:58.013+0000 7fbeeddcff00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:36:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:36:58.013+0000 7fbeeddcff00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:36:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:36:58.013+0000 7fbeeddcff00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:36:58.016 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:36:58.013+0000 7fbeeddcff00 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-07-26T15:37:00.191 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-07-26T15:37:00.208 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:37:00.251 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:00.249+0000 7efe7f190f00 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-07-26T15:37:00.252 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:00.249+0000 7efe7f190f00 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-07-26T15:37:00.252 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:00.249+0000 7efe7f190f00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:37:00.253 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:00.249+0000 7efe7f190f00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:37:00.253 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:00.249+0000 7efe7f190f00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:37:00.253 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:00.249+0000 7efe7f190f00 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-07-26T15:37:02.426 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-07-26T15:37:02.483 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:37:02.526 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:02.525+0000 7fcc1a6adf00 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-07-26T15:37:02.526 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:02.525+0000 7fcc1a6adf00 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-07-26T15:37:02.527 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:02.525+0000 7fcc1a6adf00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:37:02.527 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:02.525+0000 7fcc1a6adf00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:37:02.527 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:02.525+0000 7fcc1a6adf00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:37:02.527 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:37:02.525+0000 7fcc1a6adf00 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-07-26T15:37:04.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-07-26T15:37:04.724 INFO:tasks.ceph:Reading keys from all nodes... 2021-07-26T15:37:04.724 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:04.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2021-07-26T15:37:04.782 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:04.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2021-07-26T15:37:04.794 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:04.794 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2021-07-26T15:37:04.849 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:04.849 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2021-07-26T15:37:04.861 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:04.861 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2021-07-26T15:37:04.866 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:04.867 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2021-07-26T15:37:04.872 INFO:tasks.ceph:Adding keys to all mons... 2021-07-26T15:37:04.872 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/c2.keyring 2021-07-26T15:37:04.929 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2021-07-26T15:37:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCX1v5gDBKWMxAAdNFPc6JSa9Teqnj0L7x/CQ== 2021-07-26T15:37:04.930 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2021-07-26T15:37:04.930 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCa1v5giQPqABAANYuAsfU5WHpV6+23kr6RNw== 2021-07-26T15:37:04.930 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2021-07-26T15:37:04.930 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCc1v5g3NgGDxAAL36x9mNGjyFkdopOYh02ww== 2021-07-26T15:37:04.930 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2021-07-26T15:37:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCe1v5gH69tHxAAqXrBxlKhvAMVTHALMJZY7A== 2021-07-26T15:37:04.931 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2021-07-26T15:37:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCX1v5ggfeSNRAA+lZqDsjbZIosnsEfERT/gQ== 2021-07-26T15:37:04.931 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2021-07-26T15:37:04.932 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCX1v5gIcw0OxAAZTMrxLg34+WQM+RpRxy6vQ== 2021-07-26T15:37:04.934 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-07-26T15:37:04.973 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:37:05.016 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:37:05.055 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:37:05.140 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:37:05.181 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:37:05.221 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-07-26T15:37:05.222 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-07-26T15:37:05.279 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-07-26T15:37:05.329 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-07-26T15:37:05.343 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:37:05.394 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-07-26T15:37:05.395 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-07-26T15:37:05.395 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-07-26T15:37:05.397 INFO:tasks.ceph.c2.mon.a:Started 2021-07-26T15:37:05.398 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-07-26T15:37:05.398 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-07-26T15:37:05.398 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-07-26T15:37:05.401 INFO:tasks.ceph.c2.mgr.x:Started 2021-07-26T15:37:05.401 INFO:tasks.ceph:Setting crush tunables to default 2021-07-26T15:37:05.401 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster c2 osd crush tunables default 2021-07-26T15:37:05.618 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2021-07-26T15:37:05.627 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-07-26T15:37:05.628 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:05.628 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2021-07-26T15:37:05.644 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:05.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2021-07-26T15:37:05.660 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2021-07-26T15:37:05.661 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2021-07-26T15:37:05.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster c2 osd new dc6c87c3-1cd4-4349-8f52-83ce87d40b6f 0 2021-07-26T15:37:05.902 INFO:teuthology.orchestra.run.smithi111.stdout:0 2021-07-26T15:37:05.915 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster c2 osd new 83cdf944-7595-417f-b05b-e4b37892476c 1 2021-07-26T15:37:06.109 INFO:teuthology.orchestra.run.smithi111.stdout:1 2021-07-26T15:37:06.121 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster c2 osd new 0db18ef0-4bf1-47b5-9b5d-7a781c419036 2 2021-07-26T15:37:06.307 INFO:teuthology.orchestra.run.smithi111.stdout:2 2021-07-26T15:37:06.323 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-07-26T15:37:06.324 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-07-26T15:37:06.329 INFO:tasks.ceph.c2.osd.0:Started 2021-07-26T15:37:06.329 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-07-26T15:37:06.329 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-07-26T15:37:06.332 INFO:tasks.ceph.c2.osd.1:Started 2021-07-26T15:37:06.332 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-07-26T15:37:06.332 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-07-26T15:37:06.335 INFO:tasks.ceph.c2.osd.2:Started 2021-07-26T15:37:06.335 INFO:tasks.ceph:Waiting for OSDs to come up 2021-07-26T15:37:06.638 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-07-26T15:37:06.689 INFO:tasks.ceph.c2.osd.1.smithi111.stderr:2021-07-26T15:37:06.689+0000 7f5f81dfcf00 -1 Falling back to public interface 2021-07-26T15:37:06.694 INFO:tasks.ceph.c2.osd.2.smithi111.stderr:2021-07-26T15:37:06.693+0000 7f85a8c1ff00 -1 Falling back to public interface 2021-07-26T15:37:06.803 INFO:teuthology.misc.health.smithi111.stdout: 2021-07-26T15:37:06.803 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":5,"fsid":"667ba9a6-fbaa-4385-ace9-15df3bbe4d9e","created":"2021-07-26T15:37:05.507966+0000","modified":"2021-07-26T15:37:06.306327+0000","last_up_change":"0.000000","last_in_change":"2021-07-26T15:37:06.306327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"dc6c87c3-1cd4-4349-8f52-83ce87d40b6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"83cdf944-7595-417f-b05b-e4b37892476c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0db18ef0-4bf1-47b5-9b5d-7a781c419036","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:37:06.820 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-07-26T15:37:06.966 INFO:tasks.ceph.c2.osd.0.smithi111.stderr:2021-07-26T15:37:06.965+0000 7f7699ebaf00 -1 Falling back to public interface 2021-07-26T15:37:09.525 INFO:tasks.ceph.c2.osd.1.smithi111.stderr:2021-07-26T15:37:09.525+0000 7f5f81dfcf00 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:37:09.754 INFO:tasks.ceph.c2.osd.0.smithi111.stderr:2021-07-26T15:37:09.753+0000 7f7699ebaf00 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:37:09.767 INFO:tasks.ceph.c2.osd.2.smithi111.stderr:2021-07-26T15:37:09.769+0000 7f85a8c1ff00 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:37:11.154 INFO:tasks.ceph.c2.osd.1.smithi111.stderr:2021-07-26T15:37:11.153+0000 7f5f7d59e700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:37:11.155 INFO:tasks.ceph.c2.osd.0.smithi111.stderr:2021-07-26T15:37:11.153+0000 7f769565c700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:37:11.155 INFO:tasks.ceph.c2.osd.2.smithi111.stderr:2021-07-26T15:37:11.153+0000 7f85a43c1700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:37:13.124 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-07-26T15:37:13.385 INFO:teuthology.misc.health.smithi111.stdout: 2021-07-26T15:37:13.385 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":9,"fsid":"667ba9a6-fbaa-4385-ace9-15df3bbe4d9e","created":"2021-07-26T15:37:05.507966+0000","modified":"2021-07-26T15:37:13.156834+0000","last_up_change":"2021-07-26T15:37:12.148829+0000","last_in_change":"2021-07-26T15:37:06.306327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:37:12.224583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"dc6c87c3-1cd4-4349-8f52-83ce87d40b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":16332},{"type":"v1","addr":"172.21.15.111:6817","nonce":16332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":16332},{"type":"v1","addr":"172.21.15.111:6819","nonce":16332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":16332},{"type":"v1","addr":"172.21.15.111:6823","nonce":16332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":16332},{"type":"v1","addr":"172.21.15.111:6821","nonce":16332}]},"public_addr":"172.21.15.111:6817/16332","cluster_addr":"172.21.15.111:6819/16332","heartbeat_back_addr":"172.21.15.111:6823/16332","heartbeat_front_addr":"172.21.15.111:6821/16332","state":["exists","up"]},{"osd":1,"uuid":"83cdf944-7595-417f-b05b-e4b37892476c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":16330},{"type":"v1","addr":"172.21.15.111:6801","nonce":16330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":16330},{"type":"v1","addr":"172.21.15.111:6803","nonce":16330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":16330},{"type":"v1","addr":"172.21.15.111:6807","nonce":16330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":16330},{"type":"v1","addr":"172.21.15.111:6805","nonce":16330}]},"public_addr":"172.21.15.111:6801/16330","cluster_addr":"172.21.15.111:6803/16330","heartbeat_back_addr":"172.21.15.111:6807/16330","heartbeat_front_addr":"172.21.15.111:6805/16330","state":["exists","up"]},{"osd":2,"uuid":"0db18ef0-4bf1-47b5-9b5d-7a781c419036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":16331},{"type":"v1","addr":"172.21.15.111:6809","nonce":16331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":16331},{"type":"v1","addr":"172.21.15.111:6811","nonce":16331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":16331},{"type":"v1","addr":"172.21.15.111:6815","nonce":16331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":16331},{"type":"v1","addr":"172.21.15.111:6813","nonce":16331}]},"public_addr":"172.21.15.111:6809/16331","cluster_addr":"172.21.15.111:6811/16331","heartbeat_back_addr":"172.21.15.111:6815/16331","heartbeat_front_addr":"172.21.15.111:6813/16331","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.786054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.565974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.781240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:37:13.397 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-07-26T15:37:13.398 INFO:tasks.ceph:Creating RBD pool 2021-07-26T15:37:13.398 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster c2 osd pool create rbd 8 2021-07-26T15:37:14.177 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'rbd' created 2021-07-26T15:37:14.188 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:37:15.195 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:37:15.205 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-07-26T15:37:15.205 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:37:15.206 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-07-26T15:37:15.458 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:15.458 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"fsid":"667ba9a6-fbaa-4385-ace9-15df3bbe4d9e","created":"2021-07-26T15:37:05.507966+0000","modified":"2021-07-26T15:37:15.173683+0000","last_up_change":"2021-07-26T15:37:12.148829+0000","last_in_change":"2021-07-26T15:37:06.306327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:37:12.224583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:37:13.719274+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dc6c87c3-1cd4-4349-8f52-83ce87d40b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":16332},{"type":"v1","addr":"172.21.15.111:6817","nonce":16332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":16332},{"type":"v1","addr":"172.21.15.111:6819","nonce":16332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":16332},{"type":"v1","addr":"172.21.15.111:6823","nonce":16332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":16332},{"type":"v1","addr":"172.21.15.111:6821","nonce":16332}]},"public_addr":"172.21.15.111:6817/16332","cluster_addr":"172.21.15.111:6819/16332","heartbeat_back_addr":"172.21.15.111:6823/16332","heartbeat_front_addr":"172.21.15.111:6821/16332","state":["exists","up"]},{"osd":1,"uuid":"83cdf944-7595-417f-b05b-e4b37892476c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":16330},{"type":"v1","addr":"172.21.15.111:6801","nonce":16330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":16330},{"type":"v1","addr":"172.21.15.111:6803","nonce":16330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":16330},{"type":"v1","addr":"172.21.15.111:6807","nonce":16330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":16330},{"type":"v1","addr":"172.21.15.111:6805","nonce":16330}]},"public_addr":"172.21.15.111:6801/16330","cluster_addr":"172.21.15.111:6803/16330","heartbeat_back_addr":"172.21.15.111:6807/16330","heartbeat_front_addr":"172.21.15.111:6805/16330","state":["exists","up"]},{"osd":2,"uuid":"0db18ef0-4bf1-47b5-9b5d-7a781c419036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":16331},{"type":"v1","addr":"172.21.15.111:6809","nonce":16331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":16331},{"type":"v1","addr":"172.21.15.111:6811","nonce":16331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":16331},{"type":"v1","addr":"172.21.15.111:6815","nonce":16331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":16331},{"type":"v1","addr":"172.21.15.111:6813","nonce":16331}]},"public_addr":"172.21.15.111:6809/16331","cluster_addr":"172.21.15.111:6811/16331","heartbeat_back_addr":"172.21.15.111:6815/16331","heartbeat_front_addr":"172.21.15.111:6813/16331","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.786054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.565974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.781240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:37:15.471 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:37:12.224583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:37:13.719274+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:37:15.471 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get device_health_metrics pg_num 2021-07-26T15:37:15.742 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2021-07-26T15:37:15.755 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get rbd pg_num 2021-07-26T15:37:16.021 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2021-07-26T15:37:16.035 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-07-26T15:37:16.035 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-07-26T15:37:16.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2021-07-26T15:37:16.335 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:16.347 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":16147},{"type":"v1","addr":"172.21.15.111:6825","nonce":16147}]},"active_addr":"172.21.15.111:6825/16147","active_change":"2021-07-26T15:37:09.079828+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":563432001}]},{"addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":17553715}]}]}} 2021-07-26T15:37:16.351 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-07-26T15:37:16.352 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2021-07-26T15:37:16.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:37:16.621 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:16.621 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":12,"fsid":"667ba9a6-fbaa-4385-ace9-15df3bbe4d9e","created":"2021-07-26T15:37:05.507966+0000","modified":"2021-07-26T15:37:16.181672+0000","last_up_change":"2021-07-26T15:37:12.148829+0000","last_in_change":"2021-07-26T15:37:06.306327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:37:12.224583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:37:13.719274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dc6c87c3-1cd4-4349-8f52-83ce87d40b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":16332},{"type":"v1","addr":"172.21.15.111:6817","nonce":16332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":16332},{"type":"v1","addr":"172.21.15.111:6819","nonce":16332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":16332},{"type":"v1","addr":"172.21.15.111:6823","nonce":16332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":16332},{"type":"v1","addr":"172.21.15.111:6821","nonce":16332}]},"public_addr":"172.21.15.111:6817/16332","cluster_addr":"172.21.15.111:6819/16332","heartbeat_back_addr":"172.21.15.111:6823/16332","heartbeat_front_addr":"172.21.15.111:6821/16332","state":["exists","up"]},{"osd":1,"uuid":"83cdf944-7595-417f-b05b-e4b37892476c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":16330},{"type":"v1","addr":"172.21.15.111:6801","nonce":16330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":16330},{"type":"v1","addr":"172.21.15.111:6803","nonce":16330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":16330},{"type":"v1","addr":"172.21.15.111:6807","nonce":16330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":16330},{"type":"v1","addr":"172.21.15.111:6805","nonce":16330}]},"public_addr":"172.21.15.111:6801/16330","cluster_addr":"172.21.15.111:6803/16330","heartbeat_back_addr":"172.21.15.111:6807/16330","heartbeat_front_addr":"172.21.15.111:6805/16330","state":["exists","up"]},{"osd":2,"uuid":"0db18ef0-4bf1-47b5-9b5d-7a781c419036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":16331},{"type":"v1","addr":"172.21.15.111:6809","nonce":16331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":16331},{"type":"v1","addr":"172.21.15.111:6811","nonce":16331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":16331},{"type":"v1","addr":"172.21.15.111:6815","nonce":16331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":16331},{"type":"v1","addr":"172.21.15.111:6813","nonce":16331}]},"public_addr":"172.21.15.111:6809/16331","cluster_addr":"172.21.15.111:6811/16331","heartbeat_back_addr":"172.21.15.111:6815/16331","heartbeat_front_addr":"172.21.15.111:6813/16331","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.786054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.565974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.781240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:37:16.639 INFO:tasks.ceph.ceph_manager.c2:all up! 2021-07-26T15:37:16.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:37:16.903 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:16.904 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":12,"fsid":"667ba9a6-fbaa-4385-ace9-15df3bbe4d9e","created":"2021-07-26T15:37:05.507966+0000","modified":"2021-07-26T15:37:16.181672+0000","last_up_change":"2021-07-26T15:37:12.148829+0000","last_in_change":"2021-07-26T15:37:06.306327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:37:12.224583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:37:13.719274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dc6c87c3-1cd4-4349-8f52-83ce87d40b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":16332},{"type":"v1","addr":"172.21.15.111:6817","nonce":16332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":16332},{"type":"v1","addr":"172.21.15.111:6819","nonce":16332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":16332},{"type":"v1","addr":"172.21.15.111:6823","nonce":16332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":16332},{"type":"v1","addr":"172.21.15.111:6821","nonce":16332}]},"public_addr":"172.21.15.111:6817/16332","cluster_addr":"172.21.15.111:6819/16332","heartbeat_back_addr":"172.21.15.111:6823/16332","heartbeat_front_addr":"172.21.15.111:6821/16332","state":["exists","up"]},{"osd":1,"uuid":"83cdf944-7595-417f-b05b-e4b37892476c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":16330},{"type":"v1","addr":"172.21.15.111:6801","nonce":16330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":16330},{"type":"v1","addr":"172.21.15.111:6803","nonce":16330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":16330},{"type":"v1","addr":"172.21.15.111:6807","nonce":16330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":16330},{"type":"v1","addr":"172.21.15.111:6805","nonce":16330}]},"public_addr":"172.21.15.111:6801/16330","cluster_addr":"172.21.15.111:6803/16330","heartbeat_back_addr":"172.21.15.111:6807/16330","heartbeat_front_addr":"172.21.15.111:6805/16330","state":["exists","up"]},{"osd":2,"uuid":"0db18ef0-4bf1-47b5-9b5d-7a781c419036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":16331},{"type":"v1","addr":"172.21.15.111:6809","nonce":16331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":16331},{"type":"v1","addr":"172.21.15.111:6811","nonce":16331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":16331},{"type":"v1","addr":"172.21.15.111:6815","nonce":16331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":16331},{"type":"v1","addr":"172.21.15.111:6813","nonce":16331}]},"public_addr":"172.21.15.111:6809/16331","cluster_addr":"172.21.15.111:6811/16331","heartbeat_back_addr":"172.21.15.111:6815/16331","heartbeat_front_addr":"172.21.15.111:6813/16331","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.786054+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.565974+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:37:10.781240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:37:16.917 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-07-26T15:37:17.050 INFO:teuthology.orchestra.run.smithi111.stdout:34359738370 2021-07-26T15:37:17.051 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-07-26T15:37:17.196 INFO:teuthology.orchestra.run.smithi111.stdout:34359738372 2021-07-26T15:37:17.197 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-07-26T15:37:17.344 INFO:teuthology.orchestra.run.smithi111.stdout:34359738371 2021-07-26T15:37:17.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-07-26T15:37:17.612 INFO:teuthology.orchestra.run.smithi111.stdout:34359738370 2021-07-26T15:37:17.625 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738370 got 34359738370 for osd.0 2021-07-26T15:37:17.626 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-07-26T15:37:17.888 INFO:teuthology.orchestra.run.smithi111.stdout:34359738370 2021-07-26T15:37:17.901 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738370 for osd.1 2021-07-26T15:37:18.902 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-07-26T15:37:19.167 INFO:teuthology.orchestra.run.smithi111.stdout:34359738370 2021-07-26T15:37:19.180 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738370 for osd.1 2021-07-26T15:37:20.182 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-07-26T15:37:20.453 INFO:teuthology.orchestra.run.smithi111.stdout:34359738372 2021-07-26T15:37:20.466 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.1 2021-07-26T15:37:20.467 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2021-07-26T15:37:20.722 INFO:teuthology.orchestra.run.smithi111.stdout:34359738371 2021-07-26T15:37:20.735 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.2 2021-07-26T15:37:20.736 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-07-26T15:37:20.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-07-26T15:37:20.991 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:20.993 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2021-07-26T15:37:21.004 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-07-26T15:37:19.089987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14664,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558136,"statfs":{"total":322122547200,"available":322107531264,"internally_reserved":0,"allocated":311296,"data_stored":83847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.195761+0000","last_change":"2021-07-26T15:37:15.195761+0000","last_active":"2021-07-26T15:37:15.195761+0000","last_peered":"2021-07-26T15:37:15.195761+0000","last_clean":"2021-07-26T15:37:15.195761+0000","last_became_active":"2021-07-26T15:37:15.195436+0000","last_became_peered":"2021-07-26T15:37:15.195436+0000","last_unstale":"2021-07-26T15:37:15.195761+0000","last_undegraded":"2021-07-26T15:37:15.195761+0000","last_fullsized":"2021-07-26T15:37:15.195761+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.196617+0000","last_change":"2021-07-26T15:37:15.196617+0000","last_active":"2021-07-26T15:37:15.196617+0000","last_peered":"2021-07-26T15:37:15.196617+0000","last_clean":"2021-07-26T15:37:15.196617+0000","last_became_active":"2021-07-26T15:37:15.195586+0000","last_became_peered":"2021-07-26T15:37:15.195586+0000","last_unstale":"2021-07-26T15:37:15.196617+0000","last_undegraded":"2021-07-26T15:37:15.196617+0000","last_fullsized":"2021-07-26T15:37:15.196617+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.193971+0000","last_change":"2021-07-26T15:37:15.193971+0000","last_active":"2021-07-26T15:37:15.193971+0000","last_peered":"2021-07-26T15:37:15.193971+0000","last_clean":"2021-07-26T15:37:15.193971+0000","last_became_active":"2021-07-26T15:37:15.193417+0000","last_became_peered":"2021-07-26T15:37:15.193417+0000","last_unstale":"2021-07-26T15:37:15.193971+0000","last_undegraded":"2021-07-26T15:37:15.193971+0000","last_fullsized":"2021-07-26T15:37:15.193971+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.197178+0000","last_change":"2021-07-26T15:37:15.197178+0000","last_active":"2021-07-26T15:37:15.197178+0000","last_peered":"2021-07-26T15:37:15.197178+0000","last_clean":"2021-07-26T15:37:15.197178+0000","last_became_active":"2021-07-26T15:37:15.196123+0000","last_became_peered":"2021-07-26T15:37:15.196123+0000","last_unstale":"2021-07-26T15:37:15.197178+0000","last_undegraded":"2021-07-26T15:37:15.197178+0000","last_fullsized":"2021-07-26T15:37:15.197178+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.198099+0000","last_change":"2021-07-26T15:37:15.196888+0000","last_active":"2021-07-26T15:37:15.198099+0000","last_peered":"2021-07-26T15:37:15.198099+0000","last_clean":"2021-07-26T15:37:15.198099+0000","last_became_active":"2021-07-26T15:37:15.196358+0000","last_became_peered":"2021-07-26T15:37:15.196358+0000","last_unstale":"2021-07-26T15:37:15.198099+0000","last_undegraded":"2021-07-26T15:37:15.198099+0000","last_fullsized":"2021-07-26T15:37:15.198099+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.200589+0000","last_change":"2021-07-26T15:37:15.197066+0000","last_active":"2021-07-26T15:37:15.200589+0000","last_peered":"2021-07-26T15:37:15.200589+0000","last_clean":"2021-07-26T15:37:15.200589+0000","last_became_active":"2021-07-26T15:37:15.196690+0000","last_became_peered":"2021-07-26T15:37:15.196690+0000","last_unstale":"2021-07-26T15:37:15.200589+0000","last_undegraded":"2021-07-26T15:37:15.200589+0000","last_fullsized":"2021-07-26T15:37:15.200589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.198173+0000","last_change":"2021-07-26T15:37:15.196608+0000","last_active":"2021-07-26T15:37:15.198173+0000","last_peered":"2021-07-26T15:37:15.198173+0000","last_clean":"2021-07-26T15:37:15.198173+0000","last_became_active":"2021-07-26T15:37:15.196316+0000","last_became_peered":"2021-07-26T15:37:15.196316+0000","last_unstale":"2021-07-26T15:37:15.198173+0000","last_undegraded":"2021-07-26T15:37:15.198173+0000","last_fullsized":"2021-07-26T15:37:15.198173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.195025+0000","last_change":"2021-07-26T15:37:15.195025+0000","last_active":"2021-07-26T15:37:15.195025+0000","last_peered":"2021-07-26T15:37:15.195025+0000","last_clean":"2021-07-26T15:37:15.195025+0000","last_became_active":"2021-07-26T15:37:15.194591+0000","last_became_peered":"2021-07-26T15:37:15.194591+0000","last_unstale":"2021-07-26T15:37:15.195025+0000","last_undegraded":"2021-07-26T15:37:15.195025+0000","last_fullsized":"2021-07-26T15:37:15.195025+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-07-26T15:37:14.182097+0000","last_change":"2021-07-26T15:37:14.181537+0000","last_active":"2021-07-26T15:37:14.182097+0000","last_peered":"2021-07-26T15:37:14.182097+0000","last_clean":"2021-07-26T15:37:14.182097+0000","last_became_active":"2021-07-26T15:37:14.181231+0000","last_became_peered":"2021-07-26T15:37:14.181231+0000","last_unstale":"2021-07-26T15:37:14.182097+0000","last_undegraded":"2021-07-26T15:37:14.182097+0000","last_fullsized":"2021-07-26T15:37:14.182097+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:13.156834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:13.156834+0000","last_clean_scrub_stamp":"2021-07-26T15:37:13.156834+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4848,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852752,"statfs":{"total":107374182400,"available":107369218048,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4904,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852696,"statfs":{"total":107374182400,"available":107369160704,"internally_reserved":0,"allocated":98304,"data_stored":25629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T15:37:21.005 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-07-26T15:37:21.272 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:21.274 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2021-07-26T15:37:21.284 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-07-26T15:37:21.090458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14664,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558136,"statfs":{"total":322122547200,"available":322107531264,"internally_reserved":0,"allocated":311296,"data_stored":83847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.195761+0000","last_change":"2021-07-26T15:37:15.195761+0000","last_active":"2021-07-26T15:37:15.195761+0000","last_peered":"2021-07-26T15:37:15.195761+0000","last_clean":"2021-07-26T15:37:15.195761+0000","last_became_active":"2021-07-26T15:37:15.195436+0000","last_became_peered":"2021-07-26T15:37:15.195436+0000","last_unstale":"2021-07-26T15:37:15.195761+0000","last_undegraded":"2021-07-26T15:37:15.195761+0000","last_fullsized":"2021-07-26T15:37:15.195761+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.196617+0000","last_change":"2021-07-26T15:37:15.196617+0000","last_active":"2021-07-26T15:37:15.196617+0000","last_peered":"2021-07-26T15:37:15.196617+0000","last_clean":"2021-07-26T15:37:15.196617+0000","last_became_active":"2021-07-26T15:37:15.195586+0000","last_became_peered":"2021-07-26T15:37:15.195586+0000","last_unstale":"2021-07-26T15:37:15.196617+0000","last_undegraded":"2021-07-26T15:37:15.196617+0000","last_fullsized":"2021-07-26T15:37:15.196617+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.193971+0000","last_change":"2021-07-26T15:37:15.193971+0000","last_active":"2021-07-26T15:37:15.193971+0000","last_peered":"2021-07-26T15:37:15.193971+0000","last_clean":"2021-07-26T15:37:15.193971+0000","last_became_active":"2021-07-26T15:37:15.193417+0000","last_became_peered":"2021-07-26T15:37:15.193417+0000","last_unstale":"2021-07-26T15:37:15.193971+0000","last_undegraded":"2021-07-26T15:37:15.193971+0000","last_fullsized":"2021-07-26T15:37:15.193971+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.197178+0000","last_change":"2021-07-26T15:37:15.197178+0000","last_active":"2021-07-26T15:37:15.197178+0000","last_peered":"2021-07-26T15:37:15.197178+0000","last_clean":"2021-07-26T15:37:15.197178+0000","last_became_active":"2021-07-26T15:37:15.196123+0000","last_became_peered":"2021-07-26T15:37:15.196123+0000","last_unstale":"2021-07-26T15:37:15.197178+0000","last_undegraded":"2021-07-26T15:37:15.197178+0000","last_fullsized":"2021-07-26T15:37:15.197178+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.198099+0000","last_change":"2021-07-26T15:37:15.196888+0000","last_active":"2021-07-26T15:37:15.198099+0000","last_peered":"2021-07-26T15:37:15.198099+0000","last_clean":"2021-07-26T15:37:15.198099+0000","last_became_active":"2021-07-26T15:37:15.196358+0000","last_became_peered":"2021-07-26T15:37:15.196358+0000","last_unstale":"2021-07-26T15:37:15.198099+0000","last_undegraded":"2021-07-26T15:37:15.198099+0000","last_fullsized":"2021-07-26T15:37:15.198099+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.200589+0000","last_change":"2021-07-26T15:37:15.197066+0000","last_active":"2021-07-26T15:37:15.200589+0000","last_peered":"2021-07-26T15:37:15.200589+0000","last_clean":"2021-07-26T15:37:15.200589+0000","last_became_active":"2021-07-26T15:37:15.196690+0000","last_became_peered":"2021-07-26T15:37:15.196690+0000","last_unstale":"2021-07-26T15:37:15.200589+0000","last_undegraded":"2021-07-26T15:37:15.200589+0000","last_fullsized":"2021-07-26T15:37:15.200589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.198173+0000","last_change":"2021-07-26T15:37:15.196608+0000","last_active":"2021-07-26T15:37:15.198173+0000","last_peered":"2021-07-26T15:37:15.198173+0000","last_clean":"2021-07-26T15:37:15.198173+0000","last_became_active":"2021-07-26T15:37:15.196316+0000","last_became_peered":"2021-07-26T15:37:15.196316+0000","last_unstale":"2021-07-26T15:37:15.198173+0000","last_undegraded":"2021-07-26T15:37:15.198173+0000","last_fullsized":"2021-07-26T15:37:15.198173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-07-26T15:37:15.195025+0000","last_change":"2021-07-26T15:37:15.195025+0000","last_active":"2021-07-26T15:37:15.195025+0000","last_peered":"2021-07-26T15:37:15.195025+0000","last_clean":"2021-07-26T15:37:15.195025+0000","last_became_active":"2021-07-26T15:37:15.194591+0000","last_became_peered":"2021-07-26T15:37:15.194591+0000","last_unstale":"2021-07-26T15:37:15.195025+0000","last_undegraded":"2021-07-26T15:37:15.195025+0000","last_fullsized":"2021-07-26T15:37:15.195025+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:14.164435+0000","last_clean_scrub_stamp":"2021-07-26T15:37:14.164435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-07-26T15:37:14.182097+0000","last_change":"2021-07-26T15:37:14.181537+0000","last_active":"2021-07-26T15:37:14.182097+0000","last_peered":"2021-07-26T15:37:14.182097+0000","last_clean":"2021-07-26T15:37:14.182097+0000","last_became_active":"2021-07-26T15:37:14.181231+0000","last_became_peered":"2021-07-26T15:37:14.181231+0000","last_unstale":"2021-07-26T15:37:14.182097+0000","last_undegraded":"2021-07-26T15:37:14.182097+0000","last_fullsized":"2021-07-26T15:37:14.182097+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:37:13.156834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:37:13.156834+0000","last_clean_scrub_stamp":"2021-07-26T15:37:13.156834+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4848,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852752,"statfs":{"total":107374182400,"available":107369218048,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4904,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852696,"statfs":{"total":107374182400,"available":107369160704,"internally_reserved":0,"allocated":98304,"data_stored":25629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T15:37:21.285 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-07-26T15:37:21.286 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-07-26T15:37:21.286 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2021-07-26T15:37:21.286 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2021-07-26T15:37:21.602 INFO:teuthology.orchestra.run.smithi111.stdout: 2021-07-26T15:37:21.614 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:37:21.614 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2021-07-26T15:37:21.615 INFO:teuthology.run_tasks:Running task parallel... 2021-07-26T15:37:21.627 INFO:teuthology.task.parallel:starting parallel... 2021-07-26T15:37:21.628 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-07-26T15:37:21.628 INFO:teuthology.task.sequential:In sequential, running task install.upgrade... 2021-07-26T15:37:21.629 INFO:teuthology.task.install:project ceph config {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None} overrides {'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:37:21.629 WARNING:teuthology.task.install:remote ubuntu@smithi018.front.sepia.ceph.com came up twice (role c1.mgr.x) 2021-07-26T15:37:21.629 WARNING:teuthology.task.install:remote ubuntu@smithi018.front.sepia.ceph.com came up twice (role c1.mon.a) 2021-07-26T15:37:21.630 WARNING:teuthology.task.install:remote ubuntu@smithi018.front.sepia.ceph.com came up twice (role c1.osd.0) 2021-07-26T15:37:21.630 WARNING:teuthology.task.install:remote ubuntu@smithi018.front.sepia.ceph.com came up twice (role c1.osd.1) 2021-07-26T15:37:21.630 WARNING:teuthology.task.install:remote ubuntu@smithi018.front.sepia.ceph.com came up twice (role c1.osd.2) 2021-07-26T15:37:21.631 INFO:teuthology.task.install:remote ubuntu@smithi018.front.sepia.ceph.com config {'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:37:21.631 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:37:21.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:37:21.685 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:37:21.690 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:37:21.700 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:37:21.700 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2021-07-26T15:37:21.701 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph-common 2021-07-26T15:37:21.720 INFO:teuthology.orchestra.run.smithi018.stdout:16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:37:21.720 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:37:21.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:37:21.773 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:37:21.779 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:37:21.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:37:21.949 INFO:teuthology.task.install:Ceph deb upgrade from 16.2.5-102-gc6a1fa5a-1focal to 17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:37:21.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2021-07-26T15:37:22.052 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:37:22.114 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:37:22.115 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:37:22.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:37:22.169 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:37:22.175 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:37:22.176 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:37:22.344 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default/ 2021-07-26T15:37:22.345 INFO:teuthology.task.install.deb:Package version is 17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:37:22.471 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2021-07-26T15:37:22.472 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:37:22.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2021-07-26T15:37:22.623 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:37:22.703 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:37:22.729 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal Release [7,662 B] 2021-07-26T15:37:22.752 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:37:22.754 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:37:22.818 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2021-07-26T15:37:22.834 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:37:22.855 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main i386 Packages [3,294 B] 2021-07-26T15:37:22.858 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:37:22.904 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:37:22.917 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:37:22.931 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [17.9 kB] 2021-07-26T15:37:22.931 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [331 kB] 2021-07-26T15:37:22.938 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.6 kB] 2021-07-26T15:37:22.939 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:37:22.945 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:37:22.954 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [6,464 B] 2021-07-26T15:37:22.954 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.6 kB] 2021-07-26T15:37:22.955 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,648 B] 2021-07-26T15:37:23.327 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 2,866 kB in 1s (4,276 kB/s) 2021-07-26T15:37:24.129 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:37:24.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-6381-gbccf07c2-1focal cephadm=17.0.0-6381-gbccf07c2-1focal ceph-mds=17.0.0-6381-gbccf07c2-1focal ceph-mgr=17.0.0-6381-gbccf07c2-1focal ceph-common=17.0.0-6381-gbccf07c2-1focal ceph-fuse=17.0.0-6381-gbccf07c2-1focal ceph-test=17.0.0-6381-gbccf07c2-1focal radosgw=17.0.0-6381-gbccf07c2-1focal python3-rados=17.0.0-6381-gbccf07c2-1focal python3-rgw=17.0.0-6381-gbccf07c2-1focal python3-cephfs=17.0.0-6381-gbccf07c2-1focal python3-rbd=17.0.0-6381-gbccf07c2-1focal libcephfs2=17.0.0-6381-gbccf07c2-1focal libcephfs-dev=17.0.0-6381-gbccf07c2-1focal librados2=17.0.0-6381-gbccf07c2-1focal librbd1=17.0.0-6381-gbccf07c2-1focal rbd-fuse=17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:37:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2021-07-26T15:37:24.388 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2021-07-26T15:37:24.389 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2021-07-26T15:37:24.536 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:37:24.537 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libjaeger 2021-07-26T15:37:24.537 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:37:24.538 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2021-07-26T15:37:24.538 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-07-26T15:37:24.538 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd ceph-volume 2021-07-26T15:37:24.539 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 librgw2 python3-ceph-argparse python3-ceph-common 2021-07-26T15:37:24.539 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2021-07-26T15:37:24.539 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb 2021-07-26T15:37:24.540 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2021-07-26T15:37:24.540 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2021-07-26T15:37:24.608 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2021-07-26T15:37:24.610 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume 2021-07-26T15:37:24.610 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2021-07-26T15:37:24.611 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:37:24.611 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-07-26T15:37:24.611 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm libcephfs-dev 2021-07-26T15:37:24.611 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 librados2 libradosstriper1 librbd1 librgw2 python3-ceph-argparse 2021-07-26T15:37:24.611 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common python3-cephfs python3-rados python3-rbd python3-rgw 2021-07-26T15:37:24.612 INFO:teuthology.orchestra.run.smithi018.stdout: radosgw rbd-fuse 2021-07-26T15:37:24.803 INFO:teuthology.orchestra.run.smithi018.stdout:29 upgraded, 1 newly installed, 0 to remove and 144 not upgraded. 2021-07-26T15:37:24.804 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 159 MB of archives. 2021-07-26T15:37:24.804 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 49.1 MB of additional disk space will be used. 2021-07-26T15:37:24.804 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-6381-gbccf07c2-1focal [7,806 kB] 2021-07-26T15:37:25.400 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-6381-gbccf07c2-1focal [196 kB] 2021-07-26T15:37:25.447 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-6381-gbccf07c2-1focal [3,932 B] 2021-07-26T15:37:25.573 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-6381-gbccf07c2-1focal [7,893 kB] 2021-07-26T15:37:26.003 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-6381-gbccf07c2-1focal [1,591 kB] 2021-07-26T15:37:26.051 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-6381-gbccf07c2-1focal [85.4 kB] 2021-07-26T15:37:26.060 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-6381-gbccf07c2-1focal [1,547 kB] 2021-07-26T15:37:26.118 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-6381-gbccf07c2-1focal [2,350 kB] 2021-07-26T15:37:26.517 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-6381-gbccf07c2-1focal [3,816 B] 2021-07-26T15:37:26.530 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-6381-gbccf07c2-1focal [28.2 MB] 2021-07-26T15:37:28.701 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-6381-gbccf07c2-1focal [52.3 MB] 2021-07-26T15:37:31.575 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-6381-gbccf07c2-1focal [6,373 kB] 2021-07-26T15:37:31.672 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-6381-gbccf07c2-1focal [12.4 MB] 2021-07-26T15:37:32.937 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-6381-gbccf07c2-1focal [23.3 MB] 2021-07-26T15:37:34.000 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-6381-gbccf07c2-1focal [3,468 kB] 2021-07-26T15:37:34.033 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-6381-gbccf07c2-1focal [20.8 kB] 2021-07-26T15:37:34.033 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-6381-gbccf07c2-1focal [200 kB] 2021-07-26T15:37:34.035 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-6381-gbccf07c2-1focal [743 kB] 2021-07-26T15:37:34.058 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-6381-gbccf07c2-1focal [116 kB] 2021-07-26T15:37:34.061 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-6381-gbccf07c2-1focal [408 kB] 2021-07-26T15:37:34.147 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-6381-gbccf07c2-1focal [22.4 kB] 2021-07-26T15:37:34.164 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-6381-gbccf07c2-1focal [31.0 kB] 2021-07-26T15:37:34.167 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-6381-gbccf07c2-1focal [385 kB] 2021-07-26T15:37:34.179 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-6381-gbccf07c2-1focal [477 kB] 2021-07-26T15:37:34.206 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-6381-gbccf07c2-1focal [4,149 kB] 2021-07-26T15:37:34.381 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-6381-gbccf07c2-1focal [3,493 kB] 2021-07-26T15:37:34.494 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-6381-gbccf07c2-1focal [66.3 kB] 2021-07-26T15:37:34.496 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.0.0-6381-gbccf07c2-1focal [207 kB] 2021-07-26T15:37:34.559 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-6381-gbccf07c2-1focal [849 kB] 2021-07-26T15:37:34.642 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-07-24-1158/bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-6381-gbccf07c2-1focal [78.8 kB] 2021-07-26T15:37:35.007 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 159 MB in 10s (15.8 MB/s) 2021-07-26T15:37:35.262 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145578 files and directories currently installed.) 2021-07-26T15:37:35.266 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../00-ceph-mon_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:35.387 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:36.761 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../01-ceph-mgr-modules-core_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:37:36.900 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:37.342 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../02-ceph-mgr-k8sevents_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:37:37.460 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:37.851 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../03-ceph-mgr-diskprediction-local_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:37:37.974 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:39.163 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../04-ceph-mgr-dashboard_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:37:39.313 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:39.920 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../05-ceph-mgr-cephadm_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:37:40.062 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:40.500 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../06-ceph-mgr_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:40.625 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:41.463 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../07-ceph-mds_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:41.588 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:42.318 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../08-ceph_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:42.467 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:42.874 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../09-ceph-osd_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:43.030 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:46.104 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../10-ceph-test_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:46.261 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:51.077 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../11-ceph-base_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:51.236 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:52.701 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../12-radosgw_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:52.826 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:55.059 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../13-ceph-common_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:58.258 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../14-librbd1_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:58.357 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:59.002 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../15-libcephfs-dev_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:59.128 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:37:59.507 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../16-python3-cephfs_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:37:59.866 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:00.295 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../17-libcephfs2_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:00.429 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:00.983 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../18-python3-rgw_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:01.116 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:01.479 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../19-python3-rados_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:01.603 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:02.061 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../20-python3-ceph-argparse_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:38:02.266 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:02.640 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../21-python3-ceph-common_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:38:02.887 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:03.208 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../22-python3-rbd_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:03.342 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:03.721 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../23-libradosstriper1_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:03.846 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:04.267 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../24-librgw2_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:04.408 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:05.167 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../25-librados2_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:05.263 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:05.983 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../26-cephadm_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:06.108 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:06.470 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-volume. 2021-07-26T15:38:06.489 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../27-ceph-volume_17.0.0-6381-gbccf07c2-1focal_all.deb ... 2021-07-26T15:38:06.528 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-volume (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:07.045 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../28-ceph-fuse_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:07.169 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../29-rbd-fuse_17.0.0-6381-gbccf07c2-1focal_amd64.deb ... 2021-07-26T15:38:07.824 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (17.0.0-6381-gbccf07c2-1focal) over (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:38:08.196 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:08.323 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:08.589 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:08.715 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:08.991 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:09.151 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:09.277 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:09.604 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:09.730 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-volume (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:09.856 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:09.982 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:10.508 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:10.667 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:10.793 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:10.928 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:11.054 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:11.206 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:11.331 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:11.770 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties..usermod: no changes 2021-07-26T15:38:11.857 INFO:teuthology.orchestra.run.smithi018.stdout:..done 2021-07-26T15:38:11.876 INFO:teuthology.orchestra.run.smithi018.stdout:Fixing /var/run/ceph ownership....done 2021-07-26T15:38:12.428 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:12.554 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:13.314 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:13.364 INFO:teuthology.orchestra.run.smithi018.stdout:Installing new version of config file /etc/init.d/ceph ... 2021-07-26T15:38:13.924 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:14.410 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:14.909 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:15.730 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:15.856 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:15.999 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:16.492 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:16.619 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:16.744 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (17.0.0-6381-gbccf07c2-1focal) ... 2021-07-26T15:38:16.863 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:38:17.188 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:38:18.016 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:38:18.448 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:38:18.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo lsb_release -is 2021-07-26T15:38:18.497 INFO:teuthology.orchestra.run.smithi018.stdout:Ubuntu 2021-07-26T15:38:18.503 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:38:18.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:38:18.681 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:38:18.704 INFO:teuthology.orchestra.run.smithi018.stdout:17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:38:18.705 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:38:18.706 INFO:teuthology.task.install:The correct ceph version 17.0.0-6381-gbccf07c2-1focal is installed. 2021-07-26T15:38:18.707 DEBUG:teuthology.parallel:result is None 2021-07-26T15:38:18.707 INFO:teuthology.run_tasks:Running task rgw... 2021-07-26T15:38:18.722 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-07-26T15:38:18.723 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c2.client.0', 'c2.client.1']) 2021-07-26T15:38:18.723 INFO:tasks.rgw:Creating data pools 2021-07-26T15:38:18.724 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-07-26T15:38:18.724 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-07-26T15:38:19.930 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'default.rgw.buckets.data' created 2021-07-26T15:38:19.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-07-26T15:38:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:38:20.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-07-26T15:38:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'default.rgw.buckets.index' created 2021-07-26T15:38:21.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-07-26T15:38:22.970 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:38:22.982 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-07-26T15:38:22.982 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:38:23.557 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.data' created 2021-07-26T15:38:23.562 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-07-26T15:38:24.566 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:38:24.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-07-26T15:38:25.568 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.index' created 2021-07-26T15:38:25.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-07-26T15:38:26.593 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:38:26.602 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-07-26T15:38:26.603 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:38:26.859 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.data' already exists 2021-07-26T15:38:26.868 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-07-26T15:38:27.585 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:38:27.598 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-07-26T15:38:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.index' already exists 2021-07-26T15:38:27.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-07-26T15:38:28.589 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:38:28.599 DEBUG:tasks.rgw:Pools created 2021-07-26T15:38:28.600 INFO:tasks.rgw:Configuring compression type = random 2021-07-26T15:38:28.600 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-07-26T15:38:28.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-07-26T15:38:28.601 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-07-26T15:38:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:28.642 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:28.638+0000 7f646bc6fb00 -1 asok(0x56370deab720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.19827.asok': (13) Permission denied 2021-07-26T15:38:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:28.650+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.789 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.786+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.789 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.786+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.792 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.790+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.792 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.790+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.792 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.790+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.790+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.790+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.810 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.810 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.811 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.812 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.812 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.812 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.812 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:38:29.813 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.813 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.813 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.813 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.814 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 10 Creating default zonegroup 2021-07-26T15:38:29.814 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 20 get_system_obj_state: rctx=0x7ffe92995cc0 obj=:.pools.avail state=0x56370de817b0 s->prefetch_data=0 2021-07-26T15:38:29.814 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.810+0000 7f646bc6fb00 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-07-26T15:38:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.822+0000 7f646bc6fb00 10 WARNING: store->list_zones() returned r=-2 2021-07-26T15:38:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.822+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.822+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.826+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.826+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.826+0000 7f646bc6fb00 10 could not read realm id: (2) No such file or directory 2021-07-26T15:38:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.826+0000 7f646bc6fb00 10 WARNING: failed to set zone as default, r=-22 2021-07-26T15:38:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.826+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.830 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.826+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.833 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.830+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.834 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.830+0000 7f646bc6fb00 20 rados_obj.operate() r=0 bl.length=873 2021-07-26T15:38:29.834 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.830+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.835 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:29.835 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 zonegroup default 2021-07-26T15:38:29.835 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.836 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:29.836 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 10 Cannot find current period zone using local zone 2021-07-26T15:38:29.836 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 10 Using default name default 2021-07-26T15:38:29.836 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.837 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:29.837 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:29.838 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados_obj.operate() r=0 bl.length=873 2021-07-26T15:38:29.838 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 zone default found 2021-07-26T15:38:29.838 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:29.834+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:31.806+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:31.807 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:31.806+0000 7f646bc6fb00 20 rados->read ofs=0 len=0 2021-07-26T15:38:31.811 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:31.810+0000 7f646bc6fb00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:31.812 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:31.810+0000 7f646bc6fb00 20 started sync module instance, tier type = 2021-07-26T15:38:31.812 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:31.810+0000 7f646bc6fb00 20 started zone id=677a233b-c94a-4e91-aef2-db309be53427 (name=default) with tier type = 2021-07-26T15:38:33.844 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=0 2021-07-26T15:38:33.844 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=1 2021-07-26T15:38:33.844 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=2 2021-07-26T15:38:33.845 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=3 2021-07-26T15:38:33.845 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=4 2021-07-26T15:38:33.845 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=5 2021-07-26T15:38:33.845 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=6 2021-07-26T15:38:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 add_watcher() i=7 2021-07-26T15:38:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 2 all 8 watchers are set, enabling cache 2021-07-26T15:38:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):409: oid=data_loggenerations_metadata not found 2021-07-26T15:38:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.0 2021-07-26T15:38:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.0 does not exist 2021-07-26T15:38:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.1 2021-07-26T15:38:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.1 does not exist 2021-07-26T15:38:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.2 2021-07-26T15:38:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:33.850 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.2 does not exist 2021-07-26T15:38:33.850 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.3 2021-07-26T15:38:33.850 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.842+0000 7f646bc6fb00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:33.850 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.846+0000 7f646bc6fb00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.3 does not exist 2021-07-26T15:38:33.851 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.846+0000 7f646bc6fb00 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1203 entering 2021-07-26T15:38:33.851 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.846+0000 7f646bc6fb00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:33.851 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.850+0000 7f646bc6fb00 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:38:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.850+0000 7f646bc6fb00 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:38:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:33.850+0000 7f643efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:38:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.834+0000 7f646bc6fb00 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-07-26T15:38:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.834+0000 7f646bc6fb00 5 note: GC not initialized 2021-07-26T15:38:37.863 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.862+0000 7f63adffb700 20 reqs_thread_entry: start 2021-07-26T15:38:37.863 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.862+0000 7f63937fe700 20 reqs_thread_entry: start 2021-07-26T15:38:37.863 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.862+0000 7f646bc6fb00 20 init_complete bucket index max shards: 11 2021-07-26T15:38:37.864 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.862+0000 7f646bc6fb00 10 rgw notify: Started notification manager with: 1 workers 2021-07-26T15:38:37.864 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.862+0000 7f6391ffb700 20 rgw notify: INFO: next queues processing will happen at: Mon Jul 26 15:39:08 2021 2021-07-26T15:38:37.865 INFO:teuthology.orchestra.run.smithi018.stderr: 2021-07-26T15:38:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.862+0000 7f63917fa700 20 reqs_thread_entry: start 2021-07-26T15:38:37.896 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2021-07-26T15:38:37.897 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.894+0000 7f646bc6fb00 20 remove_watcher() i=0 2021-07-26T15:38:37.897 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.894+0000 7f646bc6fb00 2 removed watcher, disabling cache 2021-07-26T15:38:37.898 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.898+0000 7f646bc6fb00 20 remove_watcher() i=1 2021-07-26T15:38:37.900 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.898+0000 7f646bc6fb00 20 remove_watcher() i=2 2021-07-26T15:38:37.902 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.898+0000 7f646bc6fb00 20 remove_watcher() i=3 2021-07-26T15:38:37.903 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.902+0000 7f646bc6fb00 20 remove_watcher() i=4 2021-07-26T15:38:37.905 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.902+0000 7f646bc6fb00 20 remove_watcher() i=5 2021-07-26T15:38:37.907 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.906+0000 7f646bc6fb00 20 remove_watcher() i=6 2021-07-26T15:38:37.909 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.906+0000 7f646bc6fb00 20 remove_watcher() i=7 2021-07-26T15:38:37.911 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.910+0000 7f643efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:38:37.920 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:38:37.920 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:38:37.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:38:37.921 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:38:37.962 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:37.966 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.966+0000 7f92361e3b00 -1 asok(0x557ec34ad720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.19912.asok': (13) Permission denied 2021-07-26T15:38:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.970+0000 7f92361e3b00 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:38:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.970+0000 7f92361e3b00 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:38:37.980 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.978+0000 7f91d17fa700 20 reqs_thread_entry: start 2021-07-26T15:38:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.978+0000 7f92361e3b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.978+0000 7f92361e3b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.978+0000 7f92361e3b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados_obj.operate() r=0 bl.length=873 2021-07-26T15:38:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:37.985 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:37.982+0000 7f92361e3b00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:37.992 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:38:37.992 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "677a233b-c94a-4e91-aef2-db309be53427", 2021-07-26T15:38:37.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default", 2021-07-26T15:38:37.993 INFO:teuthology.orchestra.run.smithi018.stdout: "domain_root": "default.rgw.meta:root", 2021-07-26T15:38:37.993 INFO:teuthology.orchestra.run.smithi018.stdout: "control_pool": "default.rgw.control", 2021-07-26T15:38:37.993 INFO:teuthology.orchestra.run.smithi018.stdout: "gc_pool": "default.rgw.log:gc", 2021-07-26T15:38:37.993 INFO:teuthology.orchestra.run.smithi018.stdout: "lc_pool": "default.rgw.log:lc", 2021-07-26T15:38:37.994 INFO:teuthology.orchestra.run.smithi018.stdout: "log_pool": "default.rgw.log", 2021-07-26T15:38:37.994 INFO:teuthology.orchestra.run.smithi018.stdout: "intent_log_pool": "default.rgw.log:intent", 2021-07-26T15:38:37.995 INFO:teuthology.orchestra.run.smithi018.stdout: "usage_log_pool": "default.rgw.log:usage", 2021-07-26T15:38:37.995 INFO:teuthology.orchestra.run.smithi018.stdout: "roles_pool": "default.rgw.meta:roles", 2021-07-26T15:38:37.996 INFO:teuthology.orchestra.run.smithi018.stdout: "reshard_pool": "default.rgw.log:reshard", 2021-07-26T15:38:37.996 INFO:teuthology.orchestra.run.smithi018.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2021-07-26T15:38:37.996 INFO:teuthology.orchestra.run.smithi018.stdout: "user_email_pool": "default.rgw.meta:users.email", 2021-07-26T15:38:37.996 INFO:teuthology.orchestra.run.smithi018.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2021-07-26T15:38:37.996 INFO:teuthology.orchestra.run.smithi018.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2021-07-26T15:38:37.997 INFO:teuthology.orchestra.run.smithi018.stdout: "otp_pool": "default.rgw.otp", 2021-07-26T15:38:37.997 INFO:teuthology.orchestra.run.smithi018.stdout: "system_key": { 2021-07-26T15:38:37.997 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "", 2021-07-26T15:38:37.997 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "" 2021-07-26T15:38:37.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:38:37.998 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_pools": [ 2021-07-26T15:38:37.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:38:37.998 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "default-placement", 2021-07-26T15:38:37.999 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:38:37.999 INFO:teuthology.orchestra.run.smithi018.stdout: "index_pool": "default.rgw.buckets.index", 2021-07-26T15:38:37.999 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_classes": { 2021-07-26T15:38:37.999 INFO:teuthology.orchestra.run.smithi018.stdout: "STANDARD": { 2021-07-26T15:38:37.999 INFO:teuthology.orchestra.run.smithi018.stdout: "data_pool": "default.rgw.buckets.data", 2021-07-26T15:38:38.000 INFO:teuthology.orchestra.run.smithi018.stdout: "compression_type": "random" 2021-07-26T15:38:38.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:38.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:38:38.000 INFO:teuthology.orchestra.run.smithi018.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2021-07-26T15:38:38.001 INFO:teuthology.orchestra.run.smithi018.stdout: "index_type": 0 2021-07-26T15:38:38.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:38.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:38.002 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:38:38.002 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "", 2021-07-26T15:38:38.002 INFO:teuthology.orchestra.run.smithi018.stdout: "notif_pool": "default.rgw.log:notif" 2021-07-26T15:38:38.002 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:38:38.004 DEBUG:tasks.util.rgw: json result: {'id': '677a233b-c94a-4e91-aef2-db309be53427', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2021-07-26T15:38:38.005 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-07-26T15:38:38.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-07-26T15:38:38.005 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-07-26T15:38:38.043 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:38.044 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:38.055 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:38.050+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.552 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.546+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.552 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.546+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.554 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.550+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.555 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.550+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.556 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.550+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.556 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.550+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.557 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.554+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.569 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.571 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.571 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.572 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.572 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.572 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.572 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:38:39.573 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.573 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.573 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.573 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.573 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 10 Creating default zonegroup 2021-07-26T15:38:39.574 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 20 get_system_obj_state: rctx=0x7ffe17faa9a0 obj=:.pools.avail state=0x55ec16354b20 s->prefetch_data=0 2021-07-26T15:38:39.574 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.566+0000 7f3097987b00 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-07-26T15:38:39.585 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.578+0000 7f3097987b00 10 WARNING: store->list_zones() returned r=-2 2021-07-26T15:38:39.585 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.578+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.585 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.582+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.591 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.586+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.592 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.586+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.592 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.586+0000 7f3097987b00 10 could not read realm id: (2) No such file or directory 2021-07-26T15:38:39.593 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.586+0000 7f3097987b00 10 WARNING: failed to set zone as default, r=-22 2021-07-26T15:38:39.593 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.586+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.593 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.586+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.597 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.599 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados_obj.operate() r=0 bl.length=873 2021-07-26T15:38:39.599 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.600 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:39.600 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 zonegroup default 2021-07-26T15:38:39.600 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.600 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:39.601 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 10 Cannot find current period zone using local zone 2021-07-26T15:38:39.601 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 10 Using default name default 2021-07-26T15:38:39.601 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.602 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:39.602 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:39.603 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados_obj.operate() r=0 bl.length=873 2021-07-26T15:38:39.603 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 zone default found 2021-07-26T15:38:39.603 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:39.594+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:41.572 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:41.566+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:41.573 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:41.566+0000 7f3097987b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:41.576 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:41.570+0000 7f3097987b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:41.576 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:41.570+0000 7f3097987b00 20 started sync module instance, tier type = 2021-07-26T15:38:41.576 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:41.570+0000 7f3097987b00 20 started zone id=06d4027b-5c01-41d6-926e-8dec66b3f329 (name=default) with tier type = 2021-07-26T15:38:43.607 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=0 2021-07-26T15:38:43.608 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=1 2021-07-26T15:38:43.608 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=2 2021-07-26T15:38:43.608 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=3 2021-07-26T15:38:43.609 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=4 2021-07-26T15:38:43.609 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=5 2021-07-26T15:38:43.609 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=6 2021-07-26T15:38:43.610 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 20 add_watcher() i=7 2021-07-26T15:38:43.611 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.602+0000 7f3097987b00 2 all 8 watchers are set, enabling cache 2021-07-26T15:38:43.611 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):409: oid=data_loggenerations_metadata not found 2021-07-26T15:38:43.611 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.0 2021-07-26T15:38:43.611 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:43.612 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.0 does not exist 2021-07-26T15:38:43.612 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.1 2021-07-26T15:38:43.612 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:43.612 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.1 does not exist 2021-07-26T15:38:43.613 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.2 2021-07-26T15:38:43.613 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:43.613 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.2 does not exist 2021-07-26T15:38:43.613 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):37 probing oid=data_log.3 2021-07-26T15:38:43.613 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:43.614 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):59: oid=data_log.3 does not exist 2021-07-26T15:38:43.614 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1203 entering 2021-07-26T15:38:43.614 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.606+0000 7f3097987b00 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1161 entering 2021-07-26T15:38:43.621 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.618+0000 7f3097987b00 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:38:43.621 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.618+0000 7f3097987b00 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:38:43.622 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:43.618+0000 7f30667e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:38:47.586 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.582+0000 7f3097987b00 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-07-26T15:38:47.692 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.686+0000 7f30057fa700 20 reqs_thread_entry: start 2021-07-26T15:38:47.692 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.686+0000 7f2fc6ffd700 20 reqs_thread_entry: start 2021-07-26T15:38:47.693 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.686+0000 7f3097987b00 20 init_complete bucket index max shards: 11 2021-07-26T15:38:47.693 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.686+0000 7f3097987b00 10 rgw notify: Started notification manager with: 1 workers 2021-07-26T15:38:47.694 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.686+0000 7f2fc57fa700 20 rgw notify: INFO: next queues processing will happen at: Mon Jul 26 15:39:17 2021 2021-07-26T15:38:47.694 INFO:teuthology.orchestra.run.smithi111.stderr: 2021-07-26T15:38:47.694 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.690+0000 7f2fc4ff9700 20 reqs_thread_entry: start 2021-07-26T15:38:47.720 INFO:teuthology.orchestra.run.smithi111.stdout:[] 2021-07-26T15:38:47.721 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.714+0000 7f3097987b00 20 remove_watcher() i=0 2021-07-26T15:38:47.721 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.718+0000 7f3097987b00 2 removed watcher, disabling cache 2021-07-26T15:38:47.723 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.718+0000 7f3097987b00 20 remove_watcher() i=1 2021-07-26T15:38:47.726 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.722+0000 7f3097987b00 20 remove_watcher() i=2 2021-07-26T15:38:47.728 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.722+0000 7f3097987b00 20 remove_watcher() i=3 2021-07-26T15:38:47.730 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.726+0000 7f3097987b00 20 remove_watcher() i=4 2021-07-26T15:38:47.733 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.730+0000 7f3097987b00 20 remove_watcher() i=5 2021-07-26T15:38:47.735 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.730+0000 7f3097987b00 20 remove_watcher() i=6 2021-07-26T15:38:47.737 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.734+0000 7f3097987b00 20 remove_watcher() i=7 2021-07-26T15:38:47.739 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.734+0000 7f30667e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:38:47.748 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:38:47.748 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:38:47.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:38:47.749 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:38:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.842+0000 7f13ed6c7b00 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:38:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.842+0000 7f13ed6c7b00 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:38:47.857 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.850+0000 7f139cff9700 20 reqs_thread_entry: start 2021-07-26T15:38:47.857 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.850+0000 7f13ed6c7b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.858 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.858 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados_obj.operate() r=0 bl.length=873 2021-07-26T15:38:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.861 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.854+0000 7f13ed6c7b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.861 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.858+0000 7f13ed6c7b00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:47.868 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:38:47.868 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "06d4027b-5c01-41d6-926e-8dec66b3f329", 2021-07-26T15:38:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "default", 2021-07-26T15:38:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "default.rgw.meta:root", 2021-07-26T15:38:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "default.rgw.control", 2021-07-26T15:38:47.869 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "default.rgw.log:gc", 2021-07-26T15:38:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "default.rgw.log:lc", 2021-07-26T15:38:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "default.rgw.log", 2021-07-26T15:38:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "default.rgw.log:intent", 2021-07-26T15:38:47.870 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "default.rgw.log:usage", 2021-07-26T15:38:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "default.rgw.meta:roles", 2021-07-26T15:38:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "default.rgw.log:reshard", 2021-07-26T15:38:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2021-07-26T15:38:47.871 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "default.rgw.meta:users.email", 2021-07-26T15:38:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2021-07-26T15:38:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2021-07-26T15:38:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "default.rgw.otp", 2021-07-26T15:38:47.872 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:38:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "", 2021-07-26T15:38:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "" 2021-07-26T15:38:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:38:47.873 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:38:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:38:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:38:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:38:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "default.rgw.buckets.index", 2021-07-26T15:38:47.874 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:38:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:38:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "default.rgw.buckets.data", 2021-07-26T15:38:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: "compression_type": "random" 2021-07-26T15:38:47.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:38:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:38:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2021-07-26T15:38:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:38:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:38:47.876 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:38:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:38:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "", 2021-07-26T15:38:47.877 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "default.rgw.log:notif" 2021-07-26T15:38:47.878 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:38:47.879 DEBUG:tasks.util.rgw: json result: {'id': '06d4027b-5c01-41d6-926e-8dec66b3f329', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2021-07-26T15:38:47.880 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-07-26T15:38:47.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-07-26T15:38:47.881 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-07-26T15:38:47.920 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:47.934 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.930+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.930+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.937 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.930+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.937 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.930+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.937 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.930+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.934+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.934+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.934+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.950+0000 7fe38a91db00 20 RGWRados::pool_iterate: got zone_info.06d4027b-5c01-41d6-926e-8dec66b3f329 2021-07-26T15:38:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.950+0000 7fe38a91db00 20 RGWRados::pool_iterate: got zonegroup_info.d544861e-8aa8-442d-8a42-a0a0bce0c0fb 2021-07-26T15:38:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.950+0000 7fe38a91db00 20 RGWRados::pool_iterate: got zone_names.default 2021-07-26T15:38:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.950+0000 7fe38a91db00 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-07-26T15:38:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.950+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=889 2021-07-26T15:38:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.962 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:38:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.954+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 zonegroup default 2021-07-26T15:38:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 10 Cannot find current period zone using local zone 2021-07-26T15:38:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.966 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.966 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=0 bl.length=889 2021-07-26T15:38:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 zone default found 2021-07-26T15:38:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.958+0000 7fe38a91db00 20 rados->read ofs=0 len=0 2021-07-26T15:38:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.962+0000 7fe38a91db00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.962+0000 7fe38a91db00 20 started sync module instance, tier type = 2021-07-26T15:38:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.962+0000 7fe38a91db00 20 started zone id=06d4027b-5c01-41d6-926e-8dec66b3f329 (name=default) with tier type = 2021-07-26T15:38:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=0 2021-07-26T15:38:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=1 2021-07-26T15:38:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=2 2021-07-26T15:38:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=3 2021-07-26T15:38:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=4 2021-07-26T15:38:47.992 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=5 2021-07-26T15:38:47.992 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=6 2021-07-26T15:38:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 20 add_watcher() i=7 2021-07-26T15:38:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.986+0000 7fe38a91db00 2 all 8 watchers are set, enabling cache 2021-07-26T15:38:47.995 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.990+0000 7fe38a91db00 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:38:47.995 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.990+0000 7fe38a91db00 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:38:47.996 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:47.990+0000 7fe358ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:38:48.077 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.070+0000 7fe2c77fe700 20 reqs_thread_entry: start 2021-07-26T15:38:48.077 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.070+0000 7fe2c57fa700 20 reqs_thread_entry: start 2021-07-26T15:38:48.077 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.070+0000 7fe38a91db00 20 init_complete bucket index max shards: 11 2021-07-26T15:38:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.070+0000 7fe38a91db00 10 rgw notify: Started notification manager with: 1 workers 2021-07-26T15:38:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.074+0000 7fe2b37fe700 20 rgw notify: INFO: next queues processing will happen at: Mon Jul 26 15:39:18 2021 2021-07-26T15:38:48.078 INFO:teuthology.orchestra.run.smithi111.stderr: 2021-07-26T15:38:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.074+0000 7fe2b2ffd700 20 reqs_thread_entry: start 2021-07-26T15:38:48.101 INFO:teuthology.orchestra.run.smithi111.stdout:[] 2021-07-26T15:38:48.101 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.098+0000 7fe38a91db00 20 remove_watcher() i=0 2021-07-26T15:38:48.102 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.098+0000 7fe38a91db00 2 removed watcher, disabling cache 2021-07-26T15:38:48.103 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.098+0000 7fe38a91db00 20 remove_watcher() i=1 2021-07-26T15:38:48.105 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.102+0000 7fe38a91db00 20 remove_watcher() i=2 2021-07-26T15:38:48.107 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.102+0000 7fe38a91db00 20 remove_watcher() i=3 2021-07-26T15:38:48.110 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.106+0000 7fe38a91db00 20 remove_watcher() i=4 2021-07-26T15:38:48.112 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.106+0000 7fe38a91db00 20 remove_watcher() i=5 2021-07-26T15:38:48.114 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.110+0000 7fe38a91db00 20 remove_watcher() i=6 2021-07-26T15:38:48.117 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.114+0000 7fe38a91db00 20 remove_watcher() i=7 2021-07-26T15:38:48.118 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.114+0000 7fe358ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:38:48.127 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:38:48.128 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:38:48.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:38:48.128 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:38:48.208 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:48.209 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:48.222 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.218+0000 7fda8e883b00 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:38:48.222 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.218+0000 7fda8e883b00 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:38:48.228 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.222+0000 7fda8e883b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:48.229 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda14ff9700 20 reqs_thread_entry: start 2021-07-26T15:38:48.230 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:48.230 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:48.231 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados_obj.operate() r=0 bl.length=889 2021-07-26T15:38:48.232 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:48.232 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:38:48.232 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:48.233 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:38:48.233 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.226+0000 7fda8e883b00 20 rados->read ofs=0 len=0 2021-07-26T15:38:48.233 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:38:48.230+0000 7fda8e883b00 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:38:48.240 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:38:48.240 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "06d4027b-5c01-41d6-926e-8dec66b3f329", 2021-07-26T15:38:48.240 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "default", 2021-07-26T15:38:48.241 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "default.rgw.meta:root", 2021-07-26T15:38:48.241 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "default.rgw.control", 2021-07-26T15:38:48.241 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "default.rgw.log:gc", 2021-07-26T15:38:48.241 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "default.rgw.log:lc", 2021-07-26T15:38:48.242 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "default.rgw.log", 2021-07-26T15:38:48.242 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "default.rgw.log:intent", 2021-07-26T15:38:48.242 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "default.rgw.log:usage", 2021-07-26T15:38:48.242 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "default.rgw.meta:roles", 2021-07-26T15:38:48.243 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "default.rgw.log:reshard", 2021-07-26T15:38:48.243 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2021-07-26T15:38:48.243 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "default.rgw.meta:users.email", 2021-07-26T15:38:48.243 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2021-07-26T15:38:48.243 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2021-07-26T15:38:48.244 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "default.rgw.otp", 2021-07-26T15:38:48.244 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:38:48.244 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "", 2021-07-26T15:38:48.244 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "" 2021-07-26T15:38:48.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:38:48.245 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:38:48.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:38:48.245 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:38:48.246 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:38:48.246 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "default.rgw.buckets.index", 2021-07-26T15:38:48.246 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:38:48.246 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:38:48.247 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "default.rgw.buckets.data", 2021-07-26T15:38:48.247 INFO:teuthology.orchestra.run.smithi111.stdout: "compression_type": "random" 2021-07-26T15:38:48.247 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:38:48.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:38:48.247 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2021-07-26T15:38:48.248 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:38:48.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:38:48.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:38:48.248 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:38:48.249 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "", 2021-07-26T15:38:48.249 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "default.rgw.log:notif" 2021-07-26T15:38:48.250 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:38:48.251 DEBUG:tasks.util.rgw: json result: {'id': '06d4027b-5c01-41d6-926e-8dec66b3f329', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2021-07-26T15:38:48.251 INFO:tasks.rgw:Starting rgw... 2021-07-26T15:38:48.252 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-07-26T15:38:48.252 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:38:48.252 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-07-26T15:38:48.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-07-26T15:38:48.258 INFO:tasks.rgw.c1.client.0:Started 2021-07-26T15:38:48.258 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-07-26T15:38:48.258 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:38:48.259 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-07-26T15:38:48.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-07-26T15:38:48.262 INFO:tasks.rgw.c2.client.0:Started 2021-07-26T15:38:48.262 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-07-26T15:38:48.262 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:38:48.263 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:38:48.263 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:38:48.266 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:38:48.266 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi018.front.sepia.ceph.com:8000/ 2021-07-26T15:38:48.266 DEBUG:teuthology.orchestra.run.smithi018:> curl http://smithi018.front.sepia.ceph.com:8000/ 2021-07-26T15:38:48.298 INFO:teuthology.orchestra.run.smithi018.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:38:48.298 INFO:teuthology.orchestra.run.smithi018.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:38:48.298 INFO:teuthology.orchestra.run.smithi018.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:38:48.299 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:38:48.300 INFO:teuthology.orchestra.run.smithi018.stderr:curl: (7) Failed to connect to smithi018.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:38:49.301 DEBUG:teuthology.orchestra.run.smithi018:> curl http://smithi018.front.sepia.ceph.com:8000/ 2021-07-26T15:38:49.317 INFO:teuthology.orchestra.run.smithi018.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:38:49.318 INFO:teuthology.orchestra.run.smithi018.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:38:49.322 INFO:teuthology.orchestra.run.smithi018.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 53500 0 --:--:-- --:--:-- --:--:-- 53500 2021-07-26T15:38:49.322 INFO:teuthology.orchestra.run.smithi018.stdout:anonymous 2021-07-26T15:38:49.323 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi111.front.sepia.ceph.com:8000/ 2021-07-26T15:38:49.323 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8000/ 2021-07-26T15:38:49.345 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:38:49.345 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:38:49.347 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2021-07-26T15:38:49.348 INFO:teuthology.orchestra.run.smithi111.stdout:anonymous 2021-07-26T15:38:49.348 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi111.front.sepia.ceph.com:8001/ 2021-07-26T15:38:49.349 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8001/ 2021-07-26T15:38:49.409 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:38:49.410 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:38:49.411 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2021-07-26T15:38:49.412 INFO:teuthology.orchestra.run.smithi111.stdout:anonymous 2021-07-26T15:38:49.412 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-07-26T15:38:49.537 INFO:tasks.rgw_multisite:creating realm.. 2021-07-26T15:38:49.538 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:49.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:49.539 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:38:49.578 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:49.579 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:49.582+0000 7f55b6494b00 -1 asok(0x55a559b8f720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.20602.asok': (13) Permission denied 2021-07-26T15:38:49.620 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:38:49.621 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:38:49.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-realm", 2021-07-26T15:38:49.621 INFO:teuthology.orchestra.run.smithi018.stdout: "current_period": "59a80a0e-edd3-47b2-b783-bf8233ccde54", 2021-07-26T15:38:49.621 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 1 2021-07-26T15:38:49.622 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:38:49.624 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-07-26T15:38:49.625 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:49.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:49.625 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:38:49.663 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:49.663 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:49.667 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:49.666+0000 7fc1286cdb00 -1 asok(0x559a4cd85720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.20668.asok': (13) Permission denied 2021-07-26T15:38:49.686 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:49.686+0000 7fc1286cdb00 -1 old format 2021-07-26T15:38:49.700 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:38:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "test-zonegroup", 2021-07-26T15:38:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zonegroup", 2021-07-26T15:38:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "api_name": "", 2021-07-26T15:38:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "is_master": "true", 2021-07-26T15:38:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:38:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:38:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:38:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "hostnames": [], 2021-07-26T15:38:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "hostnames_s3website": [], 2021-07-26T15:38:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zone": "", 2021-07-26T15:38:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "zones": [], 2021-07-26T15:38:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_targets": [], 2021-07-26T15:38:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_placement": "", 2021-07-26T15:38:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:38:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_policy": { 2021-07-26T15:38:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "groups": [] 2021-07-26T15:38:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:49.704 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:38:49.705 INFO:tasks.rgw_multisite:creating master zone.. 2021-07-26T15:38:49.706 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--endpoints', 'http://smithi018.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:49.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--endpoints', 'http://smithi018.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:49.707 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --endpoints http://smithi018.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:38:49.798 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:49.799 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:49.803 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:49.802+0000 7f51f5715b00 -1 asok(0x561a931e0720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.20734.asok': (13) Permission denied 2021-07-26T15:38:49.856 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:38:49.856 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:38:49.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone1", 2021-07-26T15:38:49.857 INFO:teuthology.orchestra.run.smithi018.stdout: "domain_root": "test-zone1.rgw.meta:root", 2021-07-26T15:38:49.857 INFO:teuthology.orchestra.run.smithi018.stdout: "control_pool": "test-zone1.rgw.control", 2021-07-26T15:38:49.857 INFO:teuthology.orchestra.run.smithi018.stdout: "gc_pool": "test-zone1.rgw.log:gc", 2021-07-26T15:38:49.858 INFO:teuthology.orchestra.run.smithi018.stdout: "lc_pool": "test-zone1.rgw.log:lc", 2021-07-26T15:38:49.858 INFO:teuthology.orchestra.run.smithi018.stdout: "log_pool": "test-zone1.rgw.log", 2021-07-26T15:38:49.858 INFO:teuthology.orchestra.run.smithi018.stdout: "intent_log_pool": "test-zone1.rgw.log:intent", 2021-07-26T15:38:49.858 INFO:teuthology.orchestra.run.smithi018.stdout: "usage_log_pool": "test-zone1.rgw.log:usage", 2021-07-26T15:38:49.859 INFO:teuthology.orchestra.run.smithi018.stdout: "roles_pool": "test-zone1.rgw.meta:roles", 2021-07-26T15:38:49.859 INFO:teuthology.orchestra.run.smithi018.stdout: "reshard_pool": "test-zone1.rgw.log:reshard", 2021-07-26T15:38:49.859 INFO:teuthology.orchestra.run.smithi018.stdout: "user_keys_pool": "test-zone1.rgw.meta:users.keys", 2021-07-26T15:38:49.859 INFO:teuthology.orchestra.run.smithi018.stdout: "user_email_pool": "test-zone1.rgw.meta:users.email", 2021-07-26T15:38:49.860 INFO:teuthology.orchestra.run.smithi018.stdout: "user_swift_pool": "test-zone1.rgw.meta:users.swift", 2021-07-26T15:38:49.860 INFO:teuthology.orchestra.run.smithi018.stdout: "user_uid_pool": "test-zone1.rgw.meta:users.uid", 2021-07-26T15:38:49.860 INFO:teuthology.orchestra.run.smithi018.stdout: "otp_pool": "test-zone1.rgw.otp", 2021-07-26T15:38:49.860 INFO:teuthology.orchestra.run.smithi018.stdout: "system_key": { 2021-07-26T15:38:49.860 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:38:49.861 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:38:49.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:38:49.861 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_pools": [ 2021-07-26T15:38:49.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:38:49.862 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "default-placement", 2021-07-26T15:38:49.862 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:38:49.862 INFO:teuthology.orchestra.run.smithi018.stdout: "index_pool": "test-zone1.rgw.buckets.index", 2021-07-26T15:38:49.862 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_classes": { 2021-07-26T15:38:49.863 INFO:teuthology.orchestra.run.smithi018.stdout: "STANDARD": { 2021-07-26T15:38:49.863 INFO:teuthology.orchestra.run.smithi018.stdout: "data_pool": "test-zone1.rgw.buckets.data" 2021-07-26T15:38:49.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:49.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:38:49.863 INFO:teuthology.orchestra.run.smithi018.stdout: "data_extra_pool": "test-zone1.rgw.buckets.non-ec", 2021-07-26T15:38:49.864 INFO:teuthology.orchestra.run.smithi018.stdout: "index_type": 0 2021-07-26T15:38:49.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:49.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:49.864 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:38:49.865 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:38:49.865 INFO:teuthology.orchestra.run.smithi018.stdout: "notif_pool": "test-zone1.rgw.log:notif" 2021-07-26T15:38:49.865 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:38:49.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-07-26T15:38:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-07-26T15:38:50.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-07-26T15:38:51.990 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-07-26T15:38:52.009 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:52.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:52.010 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:38:52.048 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:52.049 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:52.052 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:52.050+0000 7fd3768e3b00 -1 asok(0x5638e7451720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.20852.asok': (13) Permission denied 2021-07-26T15:38:52.078 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:38:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:38:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone1", 2021-07-26T15:38:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "domain_root": "test-zone1.rgw.meta:root", 2021-07-26T15:38:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "control_pool": "test-zone1.rgw.control", 2021-07-26T15:38:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "gc_pool": "test-zone1.rgw.log:gc", 2021-07-26T15:38:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "lc_pool": "test-zone1.rgw.log:lc", 2021-07-26T15:38:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "log_pool": "test-zone1.rgw.log", 2021-07-26T15:38:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "intent_log_pool": "test-zone1.rgw.log:intent", 2021-07-26T15:38:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "usage_log_pool": "test-zone1.rgw.log:usage", 2021-07-26T15:38:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "roles_pool": "test-zone1.rgw.meta:roles", 2021-07-26T15:38:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "reshard_pool": "test-zone1.rgw.log:reshard", 2021-07-26T15:38:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "user_keys_pool": "test-zone1.rgw.meta:users.keys", 2021-07-26T15:38:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "user_email_pool": "test-zone1.rgw.meta:users.email", 2021-07-26T15:38:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "user_swift_pool": "test-zone1.rgw.meta:users.swift", 2021-07-26T15:38:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "user_uid_pool": "test-zone1.rgw.meta:users.uid", 2021-07-26T15:38:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "otp_pool": "test-zone1.rgw.otp", 2021-07-26T15:38:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "system_key": { 2021-07-26T15:38:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:38:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:38:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:38:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_pools": [ 2021-07-26T15:38:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:38:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "default-placement", 2021-07-26T15:38:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:38:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "index_pool": "test-zone1.rgw.buckets.index", 2021-07-26T15:38:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_classes": { 2021-07-26T15:38:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "STANDARD": { 2021-07-26T15:38:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "data_pool": "test-zone1.rgw.buckets.data", 2021-07-26T15:38:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "compression_type": "random" 2021-07-26T15:38:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:38:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "data_extra_pool": "test-zone1.rgw.buckets.non-ec", 2021-07-26T15:38:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "index_type": 0 2021-07-26T15:38:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:38:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:38:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "", 2021-07-26T15:38:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "notif_pool": "test-zone1.rgw.log:notif" 2021-07-26T15:38:52.087 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:38:52.088 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:52.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:38:52.089 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:38:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:38:52.134+0000 7f1728877b00 -1 asok(0x556934d47720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.20918.asok': (13) Permission denied 2021-07-26T15:39:00.094 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:39:00.094 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:00.095 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 1, 2021-07-26T15:39:00.095 INFO:teuthology.orchestra.run.smithi018.stdout: "predecessor_uuid": "59a80a0e-edd3-47b2-b783-bf8233ccde54", 2021-07-26T15:39:00.095 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_status": [], 2021-07-26T15:39:00.095 INFO:teuthology.orchestra.run.smithi018.stdout: "period_map": { 2021-07-26T15:39:00.096 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:00.096 INFO:teuthology.orchestra.run.smithi018.stdout: "zonegroups": [ 2021-07-26T15:39:00.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:00.096 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "test-zonegroup", 2021-07-26T15:39:00.097 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zonegroup", 2021-07-26T15:39:00.097 INFO:teuthology.orchestra.run.smithi018.stdout: "api_name": "", 2021-07-26T15:39:00.097 INFO:teuthology.orchestra.run.smithi018.stdout: "is_master": "true", 2021-07-26T15:39:00.097 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:39:00.097 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:39:00.098 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:00.098 INFO:teuthology.orchestra.run.smithi018.stdout: "hostnames": [], 2021-07-26T15:39:00.098 INFO:teuthology.orchestra.run.smithi018.stdout: "hostnames_s3website": [], 2021-07-26T15:39:00.098 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:00.099 INFO:teuthology.orchestra.run.smithi018.stdout: "zones": [ 2021-07-26T15:39:00.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:00.099 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:00.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone1", 2021-07-26T15:39:00.100 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:39:00.100 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:39:00.100 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:00.100 INFO:teuthology.orchestra.run.smithi018.stdout: "log_meta": "false", 2021-07-26T15:39:00.101 INFO:teuthology.orchestra.run.smithi018.stdout: "log_data": "false", 2021-07-26T15:39:00.101 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:39:00.101 INFO:teuthology.orchestra.run.smithi018.stdout: "read_only": "false", 2021-07-26T15:39:00.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_type": "", 2021-07-26T15:39:00.101 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from_all": "true", 2021-07-26T15:39:00.102 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from": [], 2021-07-26T15:39:00.102 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_zone": "" 2021-07-26T15:39:00.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:00.102 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:00.103 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_targets": [ 2021-07-26T15:39:00.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:00.103 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default-placement", 2021-07-26T15:39:00.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2021-07-26T15:39:00.104 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_classes": [ 2021-07-26T15:39:00.104 INFO:teuthology.orchestra.run.smithi018.stdout: "STANDARD" 2021-07-26T15:39:00.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2021-07-26T15:39:00.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:00.104 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:00.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_placement": "default-placement", 2021-07-26T15:39:00.105 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:00.105 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_policy": { 2021-07-26T15:39:00.105 INFO:teuthology.orchestra.run.smithi018.stdout: "groups": [] 2021-07-26T15:39:00.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:00.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:00.106 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:00.106 INFO:teuthology.orchestra.run.smithi018.stdout: "short_zone_ids": [ 2021-07-26T15:39:00.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:00.107 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:00.107 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 3535364756 2021-07-26T15:39:00.107 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:00.107 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2021-07-26T15:39:00.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:00.108 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zonegroup": "test-zonegroup", 2021-07-26T15:39:00.108 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:00.108 INFO:teuthology.orchestra.run.smithi018.stdout: "period_config": { 2021-07-26T15:39:00.109 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_quota": { 2021-07-26T15:39:00.109 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:39:00.109 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:39:00.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:39:00.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:39:00.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:39:00.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:00.110 INFO:teuthology.orchestra.run.smithi018.stdout: "user_quota": { 2021-07-26T15:39:00.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:39:00.111 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:39:00.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:39:00.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:39:00.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:39:00.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:00.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:00.112 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:00.112 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_name": "test-realm", 2021-07-26T15:39:00.112 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 2 2021-07-26T15:39:00.113 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:39:00.114 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-07-26T15:39:00.114 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:39:00.115 INFO:tasks.rgw.c1.client.0.smithi018.stdout:2021-07-26T15:39:00.114+0000 7f75095aa700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 19981) UID: 0 2021-07-26T15:39:00.116 INFO:tasks.rgw.c1.client.0.smithi018.stdout:2021-07-26T15:39:00.114+0000 7f750da71b40 -1 shutting down 2021-07-26T15:39:02.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2021-07-26T15:39:06.216 INFO:tasks.rgw.c1.client.0:Stopped 2021-07-26T15:39:06.216 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-07-26T15:39:06.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-07-26T15:39:06.220 INFO:tasks.rgw.c1.client.0:Started 2021-07-26T15:39:06.220 DEBUG:teuthology.orchestra.run.smithi018:> curl http://smithi018.front.sepia.ceph.com:8000 2021-07-26T15:39:06.237 INFO:teuthology.orchestra.run.smithi018.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:39:06.237 INFO:teuthology.orchestra.run.smithi018.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:39:06.238 INFO:teuthology.orchestra.run.smithi018.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:39:06.238 INFO:teuthology.orchestra.run.smithi018.stderr:curl: (7) Failed to connect to smithi018.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:39:06.239 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:39:07.241 DEBUG:teuthology.orchestra.run.smithi018:> curl http://smithi018.front.sepia.ceph.com:8000 2021-07-26T15:39:07.259 INFO:teuthology.orchestra.run.smithi018.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:39:07.260 INFO:teuthology.orchestra.run.smithi018.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:39:07.263 INFO:teuthology.orchestra.run.smithi018.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 71333 0 --:--:-- --:--:-- --:--:-- 71333 2021-07-26T15:39:07.264 INFO:teuthology.orchestra.run.smithi018.stdout:anonymous 2021-07-26T15:39:07.265 INFO:tasks.rgw_multisite:creating admin user.. 2021-07-26T15:39:07.265 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:07.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:07.266 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:07.312 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:07.312 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:07.316 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:39:07.314+0000 7fb49f5ccb00 -1 asok(0x5606522f4720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.21637.asok': (13) Permission denied 2021-07-26T15:39:07.405 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:39:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "user_id": "realm-admin", 2021-07-26T15:39:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "display_name": "Realm Admin", 2021-07-26T15:39:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "email": "", 2021-07-26T15:39:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "suspended": 0, 2021-07-26T15:39:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max_buckets": 1000, 2021-07-26T15:39:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "subusers": [], 2021-07-26T15:39:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "keys": [ 2021-07-26T15:39:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "user": "realm-admin", 2021-07-26T15:39:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:39:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:39:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "swift_keys": [], 2021-07-26T15:39:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": [], 2021-07-26T15:39:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "op_mask": "read, write, delete", 2021-07-26T15:39:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "system": "true", 2021-07-26T15:39:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_placement": "", 2021-07-26T15:39:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_storage_class": "", 2021-07-26T15:39:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_tags": [], 2021-07-26T15:39:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_quota": { 2021-07-26T15:39:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:39:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:39:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:39:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:39:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:39:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "user_quota": { 2021-07-26T15:39:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:39:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:39:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:39:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:39:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:39:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "temp_url_keys": [], 2021-07-26T15:39:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "rgw", 2021-07-26T15:39:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "mfa_ids": [] 2021-07-26T15:39:07.414 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:39:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:39:07.433 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-07-26T15:39:07.433 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi018.front.sepia.ceph.com:8000', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:07.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi018.front.sepia.ceph.com:8000', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:07.434 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi018.front.sepia.ceph.com:8000 --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:07.479 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:07.479 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:07.544 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-realm", 2021-07-26T15:39:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "current_period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 2 2021-07-26T15:39:07.546 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:07.547 INFO:tasks.rgw_multisite:creating zone.. 2021-07-26T15:39:07.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--endpoints', 'http://smithi111.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:07.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--endpoints', 'http://smithi111.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:07.548 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --endpoints http://smithi111.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:07.593 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:07.594 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:07.639 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:39:07.634+0000 7fcd82fd4b00 0 failed reading obj info from .rgw.root:zone_info.112afa81-a585-483c-a26d-c230749bfd0c: (2) No such file or directory 2021-07-26T15:39:07.639 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:39:07.634+0000 7fcd82fd4b00 0 WARNING: could not read zone params for zone id=112afa81-a585-483c-a26d-c230749bfd0c name=test-zone1 2021-07-26T15:39:07.651 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:07.651 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:39:07.651 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T15:39:07.651 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "test-zone2.rgw.meta:root", 2021-07-26T15:39:07.652 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "test-zone2.rgw.control", 2021-07-26T15:39:07.652 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2021-07-26T15:39:07.652 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2021-07-26T15:39:07.652 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "test-zone2.rgw.log", 2021-07-26T15:39:07.653 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2021-07-26T15:39:07.653 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2021-07-26T15:39:07.653 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2021-07-26T15:39:07.653 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2021-07-26T15:39:07.654 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2021-07-26T15:39:07.654 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2021-07-26T15:39:07.654 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2021-07-26T15:39:07.654 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2021-07-26T15:39:07.655 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "test-zone2.rgw.otp", 2021-07-26T15:39:07.655 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:39:07.655 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:39:07.655 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:39:07.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:07.656 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:39:07.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:07.656 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:39:07.657 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:07.657 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2021-07-26T15:39:07.657 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:39:07.658 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:39:07.658 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "test-zone2.rgw.buckets.data" 2021-07-26T15:39:07.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:07.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:07.658 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2021-07-26T15:39:07.659 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:39:07.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:07.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:07.659 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:07.660 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:07.660 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2021-07-26T15:39:07.660 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:07.661 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:39:08.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2021-07-26T15:39:08.564 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-07-26T15:39:08.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-07-26T15:39:09.584 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-07-26T15:39:09.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:09.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:09.605 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:09.639 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:09.640 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:09.663 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:39:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T15:39:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "test-zone2.rgw.meta:root", 2021-07-26T15:39:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "test-zone2.rgw.control", 2021-07-26T15:39:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2021-07-26T15:39:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2021-07-26T15:39:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "test-zone2.rgw.log", 2021-07-26T15:39:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2021-07-26T15:39:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2021-07-26T15:39:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2021-07-26T15:39:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2021-07-26T15:39:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2021-07-26T15:39:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2021-07-26T15:39:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2021-07-26T15:39:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2021-07-26T15:39:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "test-zone2.rgw.otp", 2021-07-26T15:39:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:39:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:39:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:39:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:39:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:39:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2021-07-26T15:39:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:39:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:39:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "test-zone2.rgw.buckets.data", 2021-07-26T15:39:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "compression_type": "random" 2021-07-26T15:39:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2021-07-26T15:39:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:39:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "", 2021-07-26T15:39:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2021-07-26T15:39:09.677 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:09.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:09.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:09.679 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:09.759 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:09.760 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:17.744 INFO:teuthology.orchestra.run.smithi111.stderr:Sending period to new master zone 112afa81-a585-483c-a26d-c230749bfd0c 2021-07-26T15:39:17.829 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:17.830 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:17.830 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 2, 2021-07-26T15:39:17.830 INFO:teuthology.orchestra.run.smithi111.stdout: "predecessor_uuid": "59a80a0e-edd3-47b2-b783-bf8233ccde54", 2021-07-26T15:39:17.831 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": [], 2021-07-26T15:39:17.831 INFO:teuthology.orchestra.run.smithi111.stdout: "period_map": { 2021-07-26T15:39:17.831 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:17.831 INFO:teuthology.orchestra.run.smithi111.stdout: "zonegroups": [ 2021-07-26T15:39:17.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:17.832 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "test-zonegroup", 2021-07-26T15:39:17.832 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zonegroup", 2021-07-26T15:39:17.832 INFO:teuthology.orchestra.run.smithi111.stdout: "api_name": "", 2021-07-26T15:39:17.832 INFO:teuthology.orchestra.run.smithi111.stdout: "is_master": "true", 2021-07-26T15:39:17.833 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:17.833 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:39:17.833 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:17.833 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames": [], 2021-07-26T15:39:17.834 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames_s3website": [], 2021-07-26T15:39:17.834 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:17.834 INFO:teuthology.orchestra.run.smithi111.stdout: "zones": [ 2021-07-26T15:39:17.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:17.835 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:17.835 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone1", 2021-07-26T15:39:17.835 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:17.835 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:39:17.835 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:17.836 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:39:17.836 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:39:17.836 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:39:17.836 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:39:17.837 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T15:39:17.837 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T15:39:17.837 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T15:39:17.837 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:39:17.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:17.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:17.838 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:39:17.838 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T15:39:17.838 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:17.839 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8000" 2021-07-26T15:39:17.839 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:17.839 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:39:17.839 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:39:17.840 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:39:17.840 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:39:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T15:39:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T15:39:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T15:39:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:39:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_targets": [ 2021-07-26T15:39:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "default-placement", 2021-07-26T15:39:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2021-07-26T15:39:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": [ 2021-07-26T15:39:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD" 2021-07-26T15:39:17.844 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:17.844 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:17.844 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:17.844 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "default-placement", 2021-07-26T15:39:17.845 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:17.845 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_policy": { 2021-07-26T15:39:17.845 INFO:teuthology.orchestra.run.smithi111.stdout: "groups": [] 2021-07-26T15:39:17.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:17.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:17.846 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:17.846 INFO:teuthology.orchestra.run.smithi111.stdout: "short_zone_ids": [ 2021-07-26T15:39:17.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:17.846 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:17.847 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 3535364756 2021-07-26T15:39:17.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:17.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:17.847 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:39:17.848 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 1401765225 2021-07-26T15:39:17.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:17.848 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:17.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:17.848 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zonegroup": "test-zonegroup", 2021-07-26T15:39:17.849 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:17.849 INFO:teuthology.orchestra.run.smithi111.stdout: "period_config": { 2021-07-26T15:39:17.849 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2021-07-26T15:39:17.849 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T15:39:17.850 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T15:39:17.850 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T15:39:17.851 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T15:39:17.851 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T15:39:17.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:17.851 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2021-07-26T15:39:17.852 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T15:39:17.852 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T15:39:17.852 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T15:39:17.852 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T15:39:17.853 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T15:39:17.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:17.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:17.853 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:17.854 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_name": "test-realm", 2021-07-26T15:39:17.854 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:17.854 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:17.855 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-07-26T15:39:17.856 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:39:17.857 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:39:17.854+0000 7f7e667fc700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 18855) UID: 0 2021-07-26T15:39:17.857 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:39:17.854+0000 7f7e6ed27b40 -1 shutting down 2021-07-26T15:39:23.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-07-26T15:39:23.957 INFO:tasks.rgw.c2.client.0:Stopped 2021-07-26T15:39:23.958 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-07-26T15:39:23.958 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-07-26T15:39:23.962 INFO:tasks.rgw.c2.client.0:Started 2021-07-26T15:39:23.963 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8000 2021-07-26T15:39:23.979 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:39:23.979 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:39:23.981 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:39:23.982 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:39:23.982 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:39:24.984 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8000 2021-07-26T15:39:25.000 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:39:25.001 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:39:25.004 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 71333 0 --:--:-- --:--:-- --:--:-- 71333 2021-07-26T15:39:25.005 INFO:teuthology.orchestra.run.smithi111.stdout:anonymous 2021-07-26T15:39:25.005 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-07-26T15:39:25.006 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi018.front.sepia.ceph.com:8000', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--url', 'http://smithi018.front.sepia.ceph.com:8000', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:25.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi018.front.sepia.ceph.com:8000', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--url', 'http://smithi018.front.sepia.ceph.com:8000', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:25.006 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi018.front.sepia.ceph.com:8000 --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --url http://smithi018.front.sepia.ceph.com:8000 --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:25.054 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:25.055 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:25.096 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:39:25.090+0000 7f8eeee0d700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.3a319e75-7fa5-4cca-8f56-1b4e52eed3a0.control err=-107 2021-07-26T15:39:25.123 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:25.123 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:25.124 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-realm", 2021-07-26T15:39:25.124 INFO:teuthology.orchestra.run.smithi111.stdout: "current_period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:25.124 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 2 2021-07-26T15:39:25.124 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:25.125 INFO:tasks.rgw_multisite:creating zone.. 2021-07-26T15:39:25.126 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--endpoints', 'http://smithi111.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:25.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'SDF05H202F7UMMJ8', '--secret', 'VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi', '--endpoints', 'http://smithi111.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:25.127 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key SDF05H202F7UMMJ8 --secret VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi --endpoints http://smithi111.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:25.217 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:25.217 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:25.274 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:39:25.270+0000 7f02b9df5b00 0 failed reading obj info from .rgw.root:zone_info.112afa81-a585-483c-a26d-c230749bfd0c: (2) No such file or directory 2021-07-26T15:39:25.275 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:39:25.270+0000 7f02b9df5b00 0 WARNING: could not read zone params for zone id=112afa81-a585-483c-a26d-c230749bfd0c name=test-zone1 2021-07-26T15:39:25.284 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:39:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone3", 2021-07-26T15:39:25.285 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "test-zone3.rgw.meta:root", 2021-07-26T15:39:25.285 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "test-zone3.rgw.control", 2021-07-26T15:39:25.285 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "test-zone3.rgw.log:gc", 2021-07-26T15:39:25.285 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "test-zone3.rgw.log:lc", 2021-07-26T15:39:25.286 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "test-zone3.rgw.log", 2021-07-26T15:39:25.286 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "test-zone3.rgw.log:intent", 2021-07-26T15:39:25.286 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "test-zone3.rgw.log:usage", 2021-07-26T15:39:25.286 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "test-zone3.rgw.meta:roles", 2021-07-26T15:39:25.286 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "test-zone3.rgw.log:reshard", 2021-07-26T15:39:25.287 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "test-zone3.rgw.meta:users.keys", 2021-07-26T15:39:25.287 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "test-zone3.rgw.meta:users.email", 2021-07-26T15:39:25.287 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "test-zone3.rgw.meta:users.swift", 2021-07-26T15:39:25.287 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "test-zone3.rgw.meta:users.uid", 2021-07-26T15:39:25.288 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "test-zone3.rgw.otp", 2021-07-26T15:39:25.288 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:39:25.288 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:39:25.288 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:39:25.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:25.289 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:39:25.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:25.289 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:39:25.289 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:25.290 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "test-zone3.rgw.buckets.index", 2021-07-26T15:39:25.290 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:39:25.290 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:39:25.290 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "test-zone3.rgw.buckets.data" 2021-07-26T15:39:25.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:25.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:25.291 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "test-zone3.rgw.buckets.non-ec", 2021-07-26T15:39:25.291 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:39:25.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:25.292 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:25.292 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:25.292 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_config": { 2021-07-26T15:39:25.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event_retention_days": 7, 2021-07-26T15:39:25.293 INFO:teuthology.orchestra.run.smithi111.stdout: "start_with_full_sync": false 2021-07-26T15:39:25.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:25.293 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:25.293 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "test-zone3.rgw.log:notif" 2021-07-26T15:39:25.294 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:25.295 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:39:26.549 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-07-26T15:39:26.562 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c2 2021-07-26T15:39:27.587 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-07-26T15:39:27.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:27.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:27.611 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:27.648 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:27.648 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:27.676 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:27.677 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:39:27.677 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone3", 2021-07-26T15:39:27.677 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "test-zone3.rgw.meta:root", 2021-07-26T15:39:27.678 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "test-zone3.rgw.control", 2021-07-26T15:39:27.678 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "test-zone3.rgw.log:gc", 2021-07-26T15:39:27.678 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "test-zone3.rgw.log:lc", 2021-07-26T15:39:27.678 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "test-zone3.rgw.log", 2021-07-26T15:39:27.679 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "test-zone3.rgw.log:intent", 2021-07-26T15:39:27.679 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "test-zone3.rgw.log:usage", 2021-07-26T15:39:27.679 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "test-zone3.rgw.meta:roles", 2021-07-26T15:39:27.679 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "test-zone3.rgw.log:reshard", 2021-07-26T15:39:27.681 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "test-zone3.rgw.meta:users.keys", 2021-07-26T15:39:27.681 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "test-zone3.rgw.meta:users.email", 2021-07-26T15:39:27.682 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "test-zone3.rgw.meta:users.swift", 2021-07-26T15:39:27.682 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "test-zone3.rgw.meta:users.uid", 2021-07-26T15:39:27.682 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "test-zone3.rgw.otp", 2021-07-26T15:39:27.682 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:39:27.683 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:39:27.684 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:39:27.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:27.685 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:39:27.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:27.685 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:39:27.685 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:27.685 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "test-zone3.rgw.buckets.index", 2021-07-26T15:39:27.686 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:39:27.686 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:39:27.686 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "test-zone3.rgw.buckets.data", 2021-07-26T15:39:27.686 INFO:teuthology.orchestra.run.smithi111.stdout: "compression_type": "random" 2021-07-26T15:39:27.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:27.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:27.687 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "test-zone3.rgw.buckets.non-ec", 2021-07-26T15:39:27.687 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:39:27.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:27.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:27.689 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:27.689 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_config": { 2021-07-26T15:39:27.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event_retention_days": 7, 2021-07-26T15:39:27.690 INFO:teuthology.orchestra.run.smithi111.stdout: "start_with_full_sync": false 2021-07-26T15:39:27.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:27.690 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "", 2021-07-26T15:39:27.690 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "test-zone3.rgw.log:notif" 2021-07-26T15:39:27.690 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:27.692 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:27.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:27.693 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:27.732 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:27.732 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:29.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2021-07-26T15:39:35.748 INFO:teuthology.orchestra.run.smithi111.stderr:Sending period to new master zone 112afa81-a585-483c-a26d-c230749bfd0c 2021-07-26T15:39:35.807 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:35.808 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:35.808 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 3, 2021-07-26T15:39:35.808 INFO:teuthology.orchestra.run.smithi111.stdout: "predecessor_uuid": "59a80a0e-edd3-47b2-b783-bf8233ccde54", 2021-07-26T15:39:35.808 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": [], 2021-07-26T15:39:35.809 INFO:teuthology.orchestra.run.smithi111.stdout: "period_map": { 2021-07-26T15:39:35.809 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:35.809 INFO:teuthology.orchestra.run.smithi111.stdout: "zonegroups": [ 2021-07-26T15:39:35.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.810 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "test-zonegroup", 2021-07-26T15:39:35.810 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zonegroup", 2021-07-26T15:39:35.810 INFO:teuthology.orchestra.run.smithi111.stdout: "api_name": "", 2021-07-26T15:39:35.810 INFO:teuthology.orchestra.run.smithi111.stdout: "is_master": "true", 2021-07-26T15:39:35.811 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:35.811 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:39:35.811 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.811 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames": [], 2021-07-26T15:39:35.811 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames_s3website": [], 2021-07-26T15:39:35.812 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:35.812 INFO:teuthology.orchestra.run.smithi111.stdout: "zones": [ 2021-07-26T15:39:35.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.812 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:35.813 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone1", 2021-07-26T15:39:35.813 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:35.813 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:39:35.813 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.813 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:39:35.814 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:39:35.814 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:39:35.814 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:39:35.814 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T15:39:35.815 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T15:39:35.815 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T15:39:35.815 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:39:35.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.816 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:39:35.816 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone3", 2021-07-26T15:39:35.816 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:35.816 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8001" 2021-07-26T15:39:35.817 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.817 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:39:35.817 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:39:35.817 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:39:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:39:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "pubsub", 2021-07-26T15:39:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "false", 2021-07-26T15:39:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [ 2021-07-26T15:39:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "test-zone1" 2021-07-26T15:39:35.819 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.819 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:39:35.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.820 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:39:35.820 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T15:39:35.820 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:39:35.820 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8000" 2021-07-26T15:39:35.820 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.821 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:39:35.821 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:39:35.821 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:39:35.821 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:39:35.822 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T15:39:35.822 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T15:39:35.822 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T15:39:35.822 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:39:35.823 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:35.823 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.823 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_targets": [ 2021-07-26T15:39:35.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.824 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "default-placement", 2021-07-26T15:39:35.824 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2021-07-26T15:39:35.824 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": [ 2021-07-26T15:39:35.824 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD" 2021-07-26T15:39:35.824 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:35.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:35.825 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.825 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "default-placement", 2021-07-26T15:39:35.825 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:35.826 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_policy": { 2021-07-26T15:39:35.826 INFO:teuthology.orchestra.run.smithi111.stdout: "groups": [] 2021-07-26T15:39:35.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:35.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:35.826 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:39:35.827 INFO:teuthology.orchestra.run.smithi111.stdout: "short_zone_ids": [ 2021-07-26T15:39:35.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.827 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:35.827 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 3535364756 2021-07-26T15:39:35.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.828 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:39:35.828 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 2230137321 2021-07-26T15:39:35.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:35.829 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:39:35.829 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 1401765225 2021-07-26T15:39:35.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:35.830 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:35.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.830 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zonegroup": "test-zonegroup", 2021-07-26T15:39:35.830 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:39:35.830 INFO:teuthology.orchestra.run.smithi111.stdout: "period_config": { 2021-07-26T15:39:35.831 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2021-07-26T15:39:35.831 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T15:39:35.831 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T15:39:35.831 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T15:39:35.831 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T15:39:35.832 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T15:39:35.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.832 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2021-07-26T15:39:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T15:39:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T15:39:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T15:39:35.838 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T15:39:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T15:39:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:35.839 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:39:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_name": "test-realm", 2021-07-26T15:39:35.840 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:35.840 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:35.841 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-07-26T15:39:35.842 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:39:35.885 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:39:35.882+0000 7f715f7fe700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 18858) UID: 0 2021-07-26T15:39:35.885 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:39:35.882+0000 7f71701afb40 -1 shutting down 2021-07-26T15:39:40.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-07-26T15:39:41.943 INFO:tasks.rgw.c2.client.1:Stopped 2021-07-26T15:39:41.944 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:39:41.944 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:39:41.947 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:39:41.948 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8001 2021-07-26T15:39:41.966 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:39:41.967 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:39:41.968 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:39:41.969 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:39:41.969 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 8001: Connection refused 2021-07-26T15:39:42.970 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8001 2021-07-26T15:39:42.988 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:39:42.988 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:39:42.989 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-07-26T15:39:42.989 INFO:teuthology.orchestra.run.smithi111.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060fed73e-10e0-test-zone3","HostId":"10e0-test-zone3-test-zonegroup"} 2021-07-26T15:39:42.990 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-07-26T15:39:42.990 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-07-26T15:39:43.006 INFO:tasks.rgw_multisite_tests:cloning suite branch pacific from https://github.com/ceph/ceph.git... 2021-07-26T15:39:43.013 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph.git 2021-07-26T15:39:43.035 INFO:teuthology.repo_utils:Fetching pacific from origin 2021-07-26T15:39:44.779 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/github.com_ceph_ceph_pacific to origin/pacific 2021-07-26T15:39:46.083 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/github.com_ceph_ceph_pacific/src/test/rgw/rgw_multi 2021-07-26T15:39:46.106 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-07-26T15:39:46.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:46.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:39:46.108 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:39:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:39:46.158+0000 7f2c29c59b00 -1 asok(0x55bc087c4720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.21903.asok': (13) Permission denied 2021-07-26T15:39:46.251 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "user_id": "rgw-multisite-test-user", 2021-07-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "display_name": "Multisite Test User", 2021-07-26T15:39:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "email": "", 2021-07-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "suspended": 0, 2021-07-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "max_buckets": 1000, 2021-07-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "subusers": [], 2021-07-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "keys": [ 2021-07-26T15:39:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "user": "rgw-multisite-test-user", 2021-07-26T15:39:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "H7Z968EWMERIOWLSZVJ4", 2021-07-26T15:39:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "JQ3TrhFAdsFH1UDPHMuDaMZZrBqptSfXRagcwTgo" 2021-07-26T15:39:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:39:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "swift_keys": [], 2021-07-26T15:39:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": [], 2021-07-26T15:39:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "op_mask": "read, write, delete", 2021-07-26T15:39:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_placement": "", 2021-07-26T15:39:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_storage_class": "", 2021-07-26T15:39:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_tags": [], 2021-07-26T15:39:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_quota": { 2021-07-26T15:39:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:39:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:39:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:39:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:39:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:39:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "user_quota": { 2021-07-26T15:39:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:39:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:39:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:39:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:39:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:39:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "temp_url_keys": [], 2021-07-26T15:39:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "rgw", 2021-07-26T15:39:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "mfa_ids": [] 2021-07-26T15:39:46.262 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:39:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: 2021-07-26T15:39:46.284 INFO:rgw_multi.tests:meta checkpoint 2021-07-26T15:39:46.285 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:46.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:46.287 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:46.328 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:46.332 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:39:46.330+0000 7f1cca715b00 -1 asok(0x56032b445720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.21979.asok': (13) Permission denied 2021-07-26T15:39:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:39:46.436 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:39:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:39:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:39:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:39:46.443 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:39:46.445 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:46.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:46.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:46.447 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:46.491 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:46.491 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:46.662 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:46.662 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:39:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:39:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:39:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:39:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:39:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:39:46.665 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:46.665 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:46.665 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:46.665 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:46.666 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:39:46.666 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:46.666 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:46.666 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:46.666 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:46.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:46.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:46.667 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:39:46.668 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:46.668 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:46.668 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:46.668 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:46.669 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:46.669 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:46.669 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:46.669 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:46.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:46.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:46.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:46.670 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:39:46.670 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:46.671 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:46.671 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:46.671 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:46.671 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:46.671 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:46.672 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:46.672 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:46.672 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:46.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:46.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:46.673 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:39:46.673 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:46.673 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:39:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:39:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:39:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:46.677 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:46.679 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:39:46.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-07-26T15:39:51.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:51.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:51.682 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:51.723 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:51.723 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:51.917 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:51.917 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:39:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:39:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:39:51.919 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:39:51.919 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:39:51.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:51.921 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:39:51.922 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:51.922 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:51.923 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:51.923 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:51.923 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:39:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:39:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:51.928 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:51.928 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:51.930 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:51.930 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:39:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:51.934 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:51.934 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:51.935 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:51.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:51.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:51.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:51.936 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:39:51.937 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:51.937 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:51.938 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:51.938 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:51.938 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:51.939 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:51.939 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:51.939 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:51.940 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:51.940 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:51.941 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:51.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:51.941 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:39:51.942 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:39:51.942 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:39:51.942 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:51.943 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:51.944 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:39:56.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.947 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:56.991 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:56.992 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:57.177 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:39:57.177 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:39:57.177 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:39:57.177 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:39:57.178 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:39:57.178 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:39:57.178 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:57.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:57.179 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:39:57.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:57.179 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:39:57.179 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:57.180 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:57.180 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:57.180 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:57.180 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:39:57.181 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:57.181 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:57.181 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:57.181 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:57.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:57.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:57.182 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:39:57.182 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:57.182 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:57.183 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:57.183 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:57.184 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:57.184 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:57.184 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:57.184 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:57.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:57.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:57.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:57.185 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:39:57.185 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:57.185 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:39:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:39:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:39:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:39:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:39:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:39:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:39:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:39:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:39:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:39:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:39:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:39:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:39:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:39:57.192 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:39:57.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:39:57.192 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:39:57.194 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:02.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.197 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:02.240 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:02.240 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:02.434 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:02.435 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:02.435 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:02.435 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:02.435 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:02.435 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:02.436 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:02.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:02.436 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:02.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:02.437 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:02.437 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:02.437 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:02.438 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:02.438 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:02.438 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:02.438 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:02.439 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:02.439 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:02.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:02.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:02.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:02.440 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:02.440 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:02.440 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:02.440 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:02.441 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:02.441 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:02.441 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:02.441 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:02.442 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:02.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:02.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:02.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:02.443 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:02.443 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:02.443 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:02.443 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:02.444 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:02.444 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:02.444 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:02.444 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:02.444 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:02.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:02.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:02.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:02.446 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:02.447 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:02.447 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:02.447 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:02.447 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:02.448 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:02.448 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:02.448 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:02.449 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:02.449 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:02.449 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:02.449 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:02.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:02.450 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:02.450 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:02.450 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:02.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:02.451 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:02.452 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:07.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.456 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:07.498 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:07.498 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:07.691 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:07.691 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:07.692 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:07.692 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:07.692 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:07.692 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:07.693 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:07.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:07.693 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:07.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:07.693 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:07.695 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:07.695 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:07.695 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:07.695 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:07.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:07.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:07.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:07.696 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:07.696 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:07.697 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:07.697 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:07.697 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:07.697 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:07.698 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:07.698 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:07.698 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:07.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:07.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:07.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:07.699 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:07.699 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:07.699 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:07.700 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:07.700 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:07.700 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:07.700 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:07.701 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:07.702 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:07.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:07.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:07.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:07.703 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:07.703 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:07.703 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:07.704 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:07.704 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:07.704 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:07.704 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:07.705 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:07.705 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:07.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:07.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:07.706 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:07.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:07.706 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:07.707 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:07.707 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:07.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:07.708 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:07.710 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:12.711 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.712 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:12.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:12.941 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:12.942 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:12.943 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:12.944 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:12.950 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:12.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:12.952 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:12.953 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:12.954 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:12.955 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:12.956 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:12.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:12.958 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:12.959 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:12.960 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:12.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:12.962 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:12.963 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:12.964 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:17.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.967 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:18.009 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:18.010 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:18.204 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:18.204 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:18.205 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:18.205 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:18.205 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:18.206 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:18.209 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:18.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:18.210 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:18.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:18.210 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:18.210 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:18.211 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:18.211 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:18.211 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:18.211 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:18.211 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:18.212 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:18.212 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:18.212 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:18.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:18.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:18.213 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:18.213 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:18.213 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:18.213 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:18.214 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:18.214 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:18.214 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:18.214 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:18.215 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:18.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:18.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:18.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:18.215 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:18.216 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:18.216 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:18.216 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:18.216 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:18.216 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:18.217 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:18.217 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:18.217 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:18.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:18.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:18.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:18.218 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:18.218 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:18.218 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:18.219 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:18.219 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:18.219 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:18.219 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:18.219 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:18.220 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:18.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:18.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:18.220 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:18.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:18.221 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:18.221 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:18.221 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:18.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:18.222 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:18.223 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:23.224 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:23.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:23.226 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:23.268 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:23.268 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:23.473 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:23.473 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:23.474 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:23.474 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:23.474 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:23.474 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:23.475 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:23.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:23.475 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:23.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:23.476 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:23.476 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:23.477 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:23.477 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:23.477 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:23.478 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:23.478 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:23.478 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:23.478 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:23.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:23.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:23.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:23.479 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:23.480 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:23.480 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:23.480 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:23.480 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:23.481 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:23.481 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:23.481 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:23.481 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:23.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:23.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:23.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:23.482 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:23.483 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:23.483 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:23.483 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:23.483 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:23.484 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:23.484 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:23.484 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:23.484 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:23.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:23.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:23.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:23.485 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:23.485 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:23.487 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:23.487 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:23.487 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:23.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:23.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:23.488 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:23.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:23.489 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:23.489 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:23.489 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:23.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:23.490 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:23.491 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:28.496 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.497 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:28.542 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:28.542 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:28.745 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:28.813 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:33.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:33.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:33.816 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:33.860 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:33.860 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:34.042 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:34.046 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:34.047 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:34.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:34.049 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:34.050 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:34.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:34.052 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:34.053 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:34.054 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:34.055 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:34.056 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:34.057 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:34.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:34.059 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:34.061 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:34.061 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:34.063 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:39.064 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:39.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:39.065 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:39.107 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:39.107 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:39.287 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:39.288 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:39.288 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:39.288 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:39.289 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:39.289 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:39.289 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:39.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:39.289 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:39.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:39.290 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:39.290 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:39.290 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:39.291 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:39.291 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:39.291 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:39.291 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:39.292 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:39.292 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:39.292 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:39.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:39.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:39.293 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:39.293 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:39.293 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:39.293 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:39.293 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:39.294 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:39.294 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:39.294 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:39.294 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:39.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:39.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:39.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:39.295 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:39.296 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:39.296 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:39.296 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:39.296 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:39.296 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:39.297 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:39.297 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:39.297 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:39.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:39.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:39.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:39.298 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:39.298 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:39.298 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:39.299 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:39.300 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:39.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:39.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:39.302 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:39.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:39.302 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:39.303 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:39.303 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:39.303 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:39.303 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:39.305 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:44.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.310 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:44.357 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:44.357 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:44.551 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:44.551 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:44.551 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:44.552 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:44.552 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:44.552 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:44.552 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:44.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:44.553 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:44.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:44.553 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:44.553 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:44.554 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:44.554 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:44.554 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:44.557 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:44.557 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:44.557 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:44.557 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:44.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:44.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:44.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:44.558 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:44.560 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:44.561 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:44.561 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:44.561 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:44.561 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:44.562 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:44.562 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:44.562 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:44.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:44.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:44.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:44.563 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:44.564 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:44.564 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:44.564 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:44.564 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:44.565 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:44.565 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:44.565 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:44.565 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:44.566 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:44.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:44.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:44.568 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:44.568 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:44.568 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:44.568 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:44.569 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:44.569 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:44.569 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:44.569 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:44.569 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:44.570 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:44.570 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:44.570 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:44.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:44.571 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:44.571 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:44.572 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:44.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:44.572 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:44.574 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:49.578 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.579 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:49.619 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:49.619 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:49.808 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:49.808 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:49.808 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:49.808 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:49.811 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:49.811 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:49.811 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:49.811 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:49.811 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:49.812 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:49.812 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:49.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:49.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:49.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:49.813 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:49.813 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:49.813 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:49.813 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:49.814 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:49.814 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:49.814 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:49.815 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:49.815 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:49.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:49.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:49.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:49.816 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:49.816 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:49.816 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:49.816 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:49.818 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:49.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:49.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:49.818 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:49.819 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:49.819 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:49.820 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:49.820 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:49.821 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:49.821 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:49.821 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:49.822 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:49.822 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:49.822 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:49.823 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:49.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:49.824 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:49.824 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:49.824 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:49.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:49.824 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:49.826 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:40:54.827 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:54.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:54.828 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:54.871 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:54.871 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:55.069 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:40:55.069 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:40:55.070 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:40:55.070 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:40:55.070 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:40:55.070 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:40:55.071 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:55.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:55.071 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:40:55.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:55.072 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:40:55.072 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:55.072 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:55.072 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:55.072 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:55.073 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:40:55.073 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:55.073 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:55.073 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:55.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:55.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:55.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:55.074 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:40:55.074 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:55.075 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:55.075 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:55.076 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:55.076 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:55.076 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:55.077 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:55.077 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:55.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:55.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:55.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:55.078 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:40:55.078 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:55.082 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:55.083 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:55.083 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:55.083 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:55.083 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:55.084 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:55.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:55.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:40:55.085 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:40:55.085 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:40:55.085 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:40:55.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:40:55.089 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:40:55.091 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:00.093 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:00.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:00.095 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:00.138 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:00.327 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:00.327 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:00.328 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:00.329 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:00.329 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:00.330 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:00.330 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:00.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:00.331 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:00.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:00.332 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:00.333 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:00.333 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:00.334 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:00.334 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:00.334 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:00.335 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:00.335 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:00.340 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:00.340 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:00.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:00.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:00.342 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:00.342 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:00.343 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:00.343 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:00.343 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:00.344 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:00.345 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:00.346 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:00.347 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:00.347 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:00.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:00.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:00.363 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:00.363 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:00.363 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:00.363 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:00.363 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:00.364 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:00.364 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:00.364 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:00.364 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:00.365 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:00.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:00.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:00.365 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:00.365 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:00.366 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:00.366 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:00.366 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:00.376 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:00.376 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:00.377 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:00.377 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:00.377 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:00.377 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:00.377 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:00.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:00.378 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:00.378 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:00.378 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:00.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:00.379 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:00.380 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:05.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:05.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:05.383 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:05.428 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:05.428 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:05.604 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:05.604 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:05.608 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:05.608 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:05.608 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:05.608 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:05.609 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:05.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:05.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:05.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:05.609 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:05.610 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:05.610 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:05.610 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:05.610 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:05.611 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:05.611 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:05.611 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:05.611 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:05.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:05.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:05.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:05.612 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:05.612 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:05.613 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:05.613 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:05.613 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:05.613 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:05.613 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:05.614 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:05.614 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:05.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:05.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:05.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:05.615 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:05.615 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:05.615 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:05.615 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:05.616 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:05.616 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:05.616 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:05.616 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:05.617 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:05.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:05.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:05.617 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:05.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:05.618 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:05.618 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:05.618 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:05.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:05.619 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:05.620 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:10.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:10.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:10.624 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:10.667 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:10.667 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:10.863 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:10.863 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:10.864 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:10.864 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:10.864 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:10.864 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:10.865 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:10.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:10.865 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:10.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:10.866 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:10.866 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:10.867 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:10.867 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:10.867 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:10.867 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:10.868 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:10.868 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:10.868 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:10.868 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:10.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:10.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:10.869 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:10.869 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:10.870 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:10.870 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:10.870 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:10.871 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:10.871 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:10.871 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:10.872 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:10.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:10.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:10.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:10.873 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:10.873 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:10.873 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:10.873 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:10.874 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:10.874 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:10.874 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:10.874 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:10.874 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:10.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:10.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:10.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:10.875 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:10.876 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:10.876 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:10.876 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:10.876 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:10.876 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:10.877 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:10.877 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:10.877 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:10.877 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:10.878 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:10.878 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:10.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:10.878 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:10.878 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:10.879 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:10.879 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:10.879 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:10.881 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:15.883 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:15.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:15.884 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:15.926 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:15.927 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:16.122 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:16.123 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:16.123 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:16.123 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:16.123 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:16.125 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:16.125 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:16.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:16.126 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:16.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:16.126 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:16.127 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:16.127 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:16.127 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:16.128 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:16.128 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:16.128 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:16.128 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:16.129 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:16.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:16.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:16.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:16.129 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:16.130 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:16.130 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:16.130 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:16.130 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:16.131 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:16.131 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:16.131 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:16.135 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:16.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:16.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:16.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:16.136 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:16.137 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:16.137 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:16.137 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:16.137 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:16.138 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:16.138 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:16.138 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:16.138 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:16.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:16.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:16.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:16.140 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:16.140 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:16.140 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:16.141 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:16.141 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:16.141 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:16.141 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:16.142 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:16.142 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:16.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:16.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:16.143 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:16.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:16.143 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:16.143 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:16.144 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:16.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:16.144 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:16.146 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:21.147 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:21.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:21.149 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:21.193 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:21.194 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:21.388 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:21.389 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:21.389 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:21.389 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:21.389 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:21.390 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:21.390 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:21.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:21.390 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:21.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:21.391 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:21.391 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:21.391 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:21.391 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:21.392 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:21.392 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:21.392 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:21.392 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:21.393 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:21.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:21.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:21.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:21.394 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:21.394 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:21.394 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:21.394 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:21.395 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:21.395 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:21.395 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:21.396 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:21.396 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:21.396 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:21.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:21.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:21.397 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:21.398 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:21.398 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:21.398 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:21.399 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:21.399 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:21.399 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:21.399 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:21.400 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:21.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:21.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:21.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:21.400 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:21.401 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:21.401 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:21.401 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:21.401 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:21.401 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:21.402 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:21.402 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:21.402 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:21.402 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:21.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:21.403 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:21.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:21.403 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:21.403 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:21.404 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:21.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:21.404 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:21.406 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:26.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:26.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:26.408 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:26.452 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:26.453 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:26.647 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:26.648 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:26.648 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:26.648 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:26.648 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:26.649 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:26.649 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:26.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:26.650 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:26.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:26.650 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:26.651 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:26.651 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:26.651 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:26.652 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:26.652 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:26.652 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:26.652 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:26.653 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:26.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:26.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:26.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:26.653 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:26.654 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:26.654 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:26.654 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:26.654 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:26.655 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:26.655 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:26.655 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:26.655 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:26.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:26.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:26.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:26.656 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:26.656 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:26.657 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:26.657 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:26.657 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:26.657 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:26.657 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:26.658 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:26.658 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:26.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:26.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:26.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:26.659 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:26.659 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:26.659 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:26.667 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:26.667 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:26.667 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:26.667 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:26.668 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:26.668 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:26.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:26.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:26.668 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:26.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:26.669 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:26.669 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:26.669 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:26.670 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:26.670 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:26.671 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:31.673 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:31.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:31.675 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:31.716 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:31.717 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:31.906 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:31.907 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:31.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:31.909 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:31.910 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:31.911 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:31.912 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:31.914 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:31.915 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:31.916 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:31.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:31.918 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:31.919 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:31.920 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:31.921 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:31.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:31.922 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:31.924 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313986.247125_58.1 target= 2021-07-26T15:41:36.925 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:36.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:36.926 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:36.967 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:36.968 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:37.167 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:37.168 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.169 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.170 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:37.174 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.175 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.177 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.178 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.184 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.185 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:37.194 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.195 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:37.197 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:37.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.198 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:37.210 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:41:37.210 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:41:37.211 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.212 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:37.253 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:37.253 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:37.459 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:37.459 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:37.460 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:37.460 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:37.460 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:37.460 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:37.461 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.461 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:37.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.462 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:37.462 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.462 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.462 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:37.462 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.463 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:37.463 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.463 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:37.463 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.464 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:37.464 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.465 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.465 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.465 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.465 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.465 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.466 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.466 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.466 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.467 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:37.467 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.467 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.467 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.468 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.468 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.468 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.468 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.468 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.469 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.469 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:37.470 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.470 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.470 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.470 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.470 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.471 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.471 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.471 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.472 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.472 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:37.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.472 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:37.472 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:37.473 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:37.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.473 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:37.474 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:41:37.475 INFO:rgw_multi.tests:meta checkpoint 2021-07-26T15:41:37.475 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.476 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:37.519 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:37.519 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:37.523 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:41:37.522+0000 7f6376e9bb00 -1 asok(0x55fea4af6720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22055.asok': (13) Permission denied 2021-07-26T15:41:37.604 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:41:37.639 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:41:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:41:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:41:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:41:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:41:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:41:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:41:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:41:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:41:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:41:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:41:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:41:37.653 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:41:37.654 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:41:37.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.656 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:37.699 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:37.700 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:37.881 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:37.881 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:37.882 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.883 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:37.884 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:37.885 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:37.886 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.887 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.889 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.890 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:37.892 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:37.893 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:37.912 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:37.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:37.913 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:37.915 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:41:37.935 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:41:37.935 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:37.936 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:37.977 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:37.977 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:38.179 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:38.180 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:38.180 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:38.180 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:38.181 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:38.181 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:38.181 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:38.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:38.181 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:38.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:38.182 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:38.182 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:38.182 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:38.183 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:38.183 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:38.183 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:38.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:38.184 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:38.184 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:38.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:38.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:38.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:38.185 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:38.185 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:38.185 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:38.185 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:38.186 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:38.186 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:38.186 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:38.187 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:38.187 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:38.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:38.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:38.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:38.188 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:38.188 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:38.188 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:38.188 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:38.189 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:38.189 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:38.189 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:38.189 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:38.190 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:38.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:38.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:38.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:38.191 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:38.191 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:38.191 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:38.191 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:38.192 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:38.192 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:38.192 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:38.192 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:38.193 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:38.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:38.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:38.193 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:38.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:38.196 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:38.197 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:38.197 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:38.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:38.197 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:38.199 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:41:38.199 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/github.com_ceph_ceph_pacific/src/test/rgw/rgw_multi' with args=['tests.py', 'tests_ps.py'] 2021-07-26T15:41:38.351 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-1 2021-07-26T15:41:42.028 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-2 2021-07-26T15:41:45.652 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:45.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:45.654 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:45.704 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:45.704 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:45.706 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:41:45.706+0000 7fbe2cc05b00 -1 asok(0x55d9e7fa5720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22135.asok': (13) Permission denied 2021-07-26T15:41:45.789 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:41:45.817 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:41:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:41:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:41:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314102.057632_52.1", 2021-07-26T15:41:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:41:42.057632Z" 2021-07-26T15:41:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:41:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:41:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:41:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:41:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:41:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:41:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:41:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:41:45.821 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:41:45.823 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:41:45.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:45.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:45.824 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:46.061 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:46.061 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:46.062 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:46.062 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:46.062 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:46.062 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:46.063 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:46.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:46.063 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:46.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:46.064 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:46.064 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:46.064 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:46.065 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:46.065 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:46.065 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:46.065 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:46.066 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:46.066 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:46.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:46.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:46.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:46.071 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:46.071 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:46.071 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:46.072 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:46.072 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:46.072 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:46.072 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:46.073 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:46.073 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:46.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:46.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:46.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:46.074 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:46.074 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:46.075 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:46.075 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:46.075 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:46.075 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:46.076 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:46.076 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:46.076 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:46.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:46.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:46.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:46.077 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:46.077 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:46.077 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:46.078 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:46.078 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:46.078 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:46.078 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:46.078 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:46.079 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:46.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:46.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:46.079 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:46.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:46.080 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:46.080 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:46.080 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:46.080 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:46.081 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:46.082 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314102.057632_52.1 target= 2021-07-26T15:41:51.084 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:51.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:51.085 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:51.126 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:51.127 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:51.313 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:51.314 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:51.315 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:51.315 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:51.316 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:51.316 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:51.317 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:51.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:51.317 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:51.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:51.324 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:51.325 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:51.325 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:51.325 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:51.325 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:51.326 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:51.326 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:51.326 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:51.326 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:51.327 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:51.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:51.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:51.327 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:51.327 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:51.328 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:51.328 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:51.328 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:51.328 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:51.329 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:51.329 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:51.329 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:51.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:51.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:51.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:51.330 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:51.330 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:51.330 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:51.331 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:51.331 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:51.331 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:51.331 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:51.331 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:51.332 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:51.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:51.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:51.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:51.333 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:51.333 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:51.334 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:51.335 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:51.335 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:51.335 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:51.335 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:51.335 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:51.336 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:51.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:51.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:51.336 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:51.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:51.337 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:51.337 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:51.337 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:51.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:51.338 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:51.339 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314102.057632_52.1 target= 2021-07-26T15:41:56.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:56.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:56.343 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:56.383 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:56.384 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:56.584 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:41:56.585 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:41:56.585 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:41:56.585 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:41:56.585 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:41:56.586 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:41:56.586 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:56.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:56.586 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:41:56.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:56.587 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:41:56.587 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:56.587 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:56.587 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:41:56.588 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:56.588 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:41:56.588 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:56.588 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:41:56.588 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:56.589 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:56.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:56.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:56.589 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:41:56.590 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:56.590 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:56.590 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:56.590 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:56.590 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:56.591 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:56.591 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:56.591 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:56.591 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:56.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:56.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:56.592 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:41:56.592 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:56.592 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:56.593 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:56.593 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:56.593 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:56.593 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:56.594 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:56.594 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:56.595 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:56.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:56.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:41:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:41:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:41:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:41:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:41:56.596 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:41:56.597 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:41:56.597 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:41:56.597 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:41:56.597 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:41:56.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:56.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:56.598 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:41:56.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:41:56.598 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:41:56.599 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:41:56.599 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:41:56.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:41:56.599 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:41:56.601 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314102.057632_52.1 target= 2021-07-26T15:42:01.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:01.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:01.604 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:01.643 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:01.644 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:01.843 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:01.843 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:01.843 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:01.844 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:01.844 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:01.844 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:01.844 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:01.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:01.845 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:01.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:01.845 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:01.846 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:01.846 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:01.847 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:01.847 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:01.847 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:01.847 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:01.848 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:01.848 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:01.849 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:01.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:01.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:01.849 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:01.849 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:01.850 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:01.850 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314102.057632_52.1", 2021-07-26T15:42:01.850 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:01.853 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:01.853 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:01.853 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:41:42.057632Z", 2021-07-26T15:42:01.853 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:01.854 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:01.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:01.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:01.854 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:01.855 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:01.855 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:01.855 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:01.855 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:01.855 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:01.856 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:01.856 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:01.856 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:01.856 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:01.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:01.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:01.857 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:01.857 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:01.857 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:01.858 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:01.858 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:01.858 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:01.859 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:01.860 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:01.860 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:01.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:01.861 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:01.861 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:01.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:01.862 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:01.862 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:01.864 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:01.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:01.865 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:01.867 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:42:01.868 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:42:01.869 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:01.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:01.870 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:01.911 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:01.911 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:02.090 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314102.057632_52.1", 2021-07-26T15:42:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:41:42.057632Z", 2021-07-26T15:42:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.118 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:02.119 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:42:02.145 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2021-07-26T15:42:02.146 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-3 2021-07-26T15:42:02.172 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-4 2021-07-26T15:42:02.219 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:02.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:02.220 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:42:02.270+0000 7ff4ce49ab00 -1 asok(0x560ab718c720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22211.asok': (13) Permission denied 2021-07-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:42:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:42:02.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:02.378 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:02.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:42:02.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:02.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:02.378 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:02.379 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:02.200076Z" 2021-07-26T15:42:02.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:02.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:02.379 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:02.380 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:02.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:02.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:02.380 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:02.380 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:02.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:42:02.381 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:42:02.382 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:42:02.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:02.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:02.384 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:02.425 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:02.425 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:02.619 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:02.619 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:02.619 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:02.620 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:02.620 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:02.620 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:02.620 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.621 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:02.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.621 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:02.621 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.622 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.622 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:02.622 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.622 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:02.622 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.623 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:02.623 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.623 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.624 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:02.624 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.624 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.624 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314102.057632_52.1", 2021-07-26T15:42:02.625 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.625 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:02.625 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.625 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:41:42.057632Z", 2021-07-26T15:42:02.625 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.626 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:02.627 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.627 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.627 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:02.627 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.627 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:02.628 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.628 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:02.628 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.628 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:02.629 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:02.629 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:02.630 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:02.630 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:02.630 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:02.630 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:02.630 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:02.631 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:02.631 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:02.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:02.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:02.632 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:02.632 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:02.632 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:02.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:02.633 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:02.634 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314122.200076_61.1 target=1_1627314102.057632_52.1 2021-07-26T15:42:07.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:07.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:07.641 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:07.697 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:07.698 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:07.906 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:07.908 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:07.908 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:07.909 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:07.909 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:07.909 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:07.909 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:07.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:07.910 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:07.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:07.910 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:07.911 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:07.911 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:07.911 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:07.911 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:07.912 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:07.912 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:07.912 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:07.912 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:07.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:07.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:07.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:07.914 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:07.914 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:07.914 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:07.914 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314102.057632_52.1", 2021-07-26T15:42:07.915 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:07.915 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:07.916 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:07.916 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:41:42.057632Z", 2021-07-26T15:42:07.916 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:07.916 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:07.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:07.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:07.917 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:07.917 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:07.918 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:07.918 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:07.918 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:07.918 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:07.918 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:07.919 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:07.919 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:07.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:07.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:07.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:07.920 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:07.920 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:07.920 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:07.920 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:07.921 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:07.921 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:07.921 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:07.921 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:07.922 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:07.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:07.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:07.922 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:07.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:07.923 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:07.923 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:07.923 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:07.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:07.924 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:07.925 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314122.200076_61.1 target=1_1627314102.057632_52.1 2021-07-26T15:42:12.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:12.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:12.927 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:12.971 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:12.971 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:13.169 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:13.169 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:13.169 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:13.169 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:13.170 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:13.170 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:13.170 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:13.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:13.171 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:13.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:13.171 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:13.171 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:13.172 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:13.172 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:13.172 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:13.172 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:13.172 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:13.173 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:13.173 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:13.174 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:13.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:13.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:13.174 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:13.175 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:13.175 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:13.175 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314102.057632_52.1", 2021-07-26T15:42:13.175 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:13.175 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:13.176 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:13.176 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:41:42.057632Z", 2021-07-26T15:42:13.176 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:13.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:13.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:13.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:13.177 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:13.177 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:13.177 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:13.178 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:13.178 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:13.178 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:13.178 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:13.178 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:13.182 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:13.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:13.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:13.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:13.188 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:13.188 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:13.189 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:13.189 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:13.189 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:13.189 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:13.189 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:13.190 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:13.190 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:13.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:13.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:13.191 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:13.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:13.191 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:13.191 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:13.192 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:13.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:13.192 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:13.193 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314122.200076_61.1 target=1_1627314102.057632_52.1 2021-07-26T15:42:18.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:18.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:18.197 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:18.239 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:18.239 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:18.446 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:18.446 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:18.447 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:18.447 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:18.447 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:18.447 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:18.448 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.448 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:18.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.449 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:18.449 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.449 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.449 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:18.450 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.450 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:18.450 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.450 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:18.451 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.451 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:18.452 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.452 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.452 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:18.452 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.453 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:18.453 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.453 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:18.453 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.453 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.454 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:18.455 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.455 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.455 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:18.455 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.455 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:18.456 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.456 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:18.456 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.457 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:18.457 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.457 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.458 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:18.458 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.458 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:18.459 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.459 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:18.459 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.459 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.460 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:18.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.460 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:18.460 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.461 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:18.483 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:42:18.484 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:42:18.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:18.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:18.486 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:18.539 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:18.540 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:18.719 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:18.720 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:18.720 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:18.720 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:18.721 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:18.721 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:18.721 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.721 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:18.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.722 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:18.722 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.732 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.732 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:18.732 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.732 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:18.733 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.733 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:18.733 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.734 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:18.734 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.734 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.735 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:18.735 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.735 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:18.735 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.738 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:18.738 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.738 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.739 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:18.740 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.740 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:18.740 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.740 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:18.741 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:18.742 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:18.742 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:18.742 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:18.742 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:18.743 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:18.743 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:18.743 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:18.743 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:18.744 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:18.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.744 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:18.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:18.745 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:18.745 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:18.745 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:18.746 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:18.746 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:18.746 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:42:18.872 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:18.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:18.887 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:18.929 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:18.930 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:42:18.934+0000 7fd0fdaa7b00 -1 asok(0x55ca55d21720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22287.asok': (13) Permission denied 2021-07-26T15:42:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:42:19.040 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:42:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:42:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:02.200076Z" 2021-07-26T15:42:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:42:19.044 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:42:19.046 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:42:19.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.048 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:19.103 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:19.103 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:19.301 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:19.301 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:19.301 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:19.301 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:19.302 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:19.302 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.303 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:19.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.303 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:19.304 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.304 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.304 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:19.304 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.305 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:19.305 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.305 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:19.305 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.306 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:19.306 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.307 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.307 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:19.307 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.308 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:19.308 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.308 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:19.308 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.309 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:19.309 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.310 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.310 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:19.310 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.311 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:19.312 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.312 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:19.312 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.312 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.313 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:19.313 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.314 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.314 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:19.315 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.315 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:19.315 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.315 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:19.316 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.316 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:19.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.317 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:19.317 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:19.317 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:19.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.318 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:19.319 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:42:19.320 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:42:19.321 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.322 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:19.407 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:19.408 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:19.597 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:19.598 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:19.598 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:19.603 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:19.603 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:19.604 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:19.604 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.604 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:19.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.605 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:19.605 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.605 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.605 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:19.606 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.606 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:19.606 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.613 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:19.614 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.620 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:19.620 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.620 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:19.620 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.621 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:19.621 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.621 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.622 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:19.622 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.623 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.623 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:19.623 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.623 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:19.624 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.624 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:19.624 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.624 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:19.638 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:19.639 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:19.639 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:19.639 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:19.639 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:19.640 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:19.640 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:19.640 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:19.640 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:19.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.641 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:19.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:19.642 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:19.656 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:19.656 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:19.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:19.657 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:19.658 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:42:19.695 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2021-07-26T15:42:19.696 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-5 2021-07-26T15:42:19.722 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-6 2021-07-26T15:42:19.773 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.774 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:19.819 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:19.820 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:19.820 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:42:19.822+0000 7f3c2a8deb00 -1 asok(0x55a02f815720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22363.asok': (13) Permission denied 2021-07-26T15:42:19.893 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:42:19.920 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:42:19.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.920 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:19.921 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:42:19.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:19.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.921 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314139.750935_74.1", 2021-07-26T15:42:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:19.750935Z" 2021-07-26T15:42:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:19.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:19.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:19.924 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:19.924 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:19.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:42:19.924 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:42:19.926 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:42:19.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:19.928 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:19.991 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:20.189 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:20.190 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:20.190 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:20.190 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:20.190 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:20.191 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:20.191 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:20.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:20.191 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:20.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:20.192 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:20.192 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:20.207 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:20.207 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:20.207 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:20.208 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:20.208 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:20.208 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:20.208 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:20.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:20.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:20.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:20.209 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:20.209 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:20.210 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:20.210 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:20.210 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:20.218 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:20.219 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:20.219 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:20.219 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:20.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:20.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:20.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:20.222 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:20.222 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:20.222 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:20.225 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:20.225 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:20.225 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:20.225 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:20.226 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:20.226 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:20.226 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:20.226 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:20.227 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:20.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:20.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:20.227 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:20.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:20.228 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:20.228 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:20.228 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:20.228 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:20.229 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:20.230 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314139.750935_74.1 target=1_1627314122.200076_61.1 2021-07-26T15:42:25.232 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:25.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:25.234 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:25.276 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:25.277 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:25.481 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:25.481 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:25.482 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:25.482 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:25.482 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:25.482 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:25.483 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:25.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:25.483 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:25.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:25.484 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:25.484 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:25.484 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:25.484 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:25.484 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:25.485 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:25.485 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:25.486 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:25.486 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:25.486 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:25.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:25.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:25.487 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:25.487 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:25.488 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:25.488 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:25.488 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:25.488 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:25.489 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:25.493 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:25.495 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:25.496 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:25.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:25.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:25.497 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:25.498 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:25.498 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:25.498 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:25.498 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:25.499 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:25.499 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:25.499 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:25.499 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:25.499 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:25.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:25.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:25.500 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:25.500 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:25.501 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:25.501 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:25.501 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:25.501 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:25.502 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:25.502 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:25.502 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:25.502 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:25.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:25.503 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:25.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:25.503 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:25.504 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:25.505 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:25.506 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:25.506 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:25.508 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314139.750935_74.1 target=1_1627314122.200076_61.1 2021-07-26T15:42:30.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:30.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:30.511 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:30.554 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:30.555 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:30.744 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:30.745 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:30.745 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:30.745 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:30.746 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:30.746 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:30.747 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:30.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:30.747 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:30.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:30.748 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:30.748 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:30.748 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:30.748 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:30.749 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:30.749 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:30.749 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:30.749 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:30.749 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:30.750 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:30.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:30.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:30.750 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:30.751 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:30.751 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:30.752 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:30.752 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:30.752 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:30.752 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:30.752 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:30.753 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:30.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:30.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:30.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:30.754 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:30.754 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:30.754 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:30.754 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:30.754 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:30.755 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:30.755 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:30.755 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:30.755 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:30.756 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:30.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:30.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:30.756 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:30.757 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:30.757 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:30.757 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:30.757 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:30.758 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:30.758 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:30.758 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:30.758 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:30.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:30.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:30.759 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:30.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:30.759 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:30.760 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:30.760 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:30.760 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:30.760 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:30.763 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314139.750935_74.1 target=1_1627314122.200076_61.1 2021-07-26T15:42:35.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:35.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:35.766 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:35.810 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:35.811 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:36.020 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:36.020 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:36.021 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:36.021 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:36.021 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:36.021 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:36.022 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:36.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:36.022 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:36.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:36.023 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:36.023 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:36.023 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:36.023 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:36.023 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:36.024 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:36.024 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:36.024 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:36.024 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:36.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:36.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:36.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:36.025 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:36.026 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:36.026 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:36.026 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314122.200076_61.1", 2021-07-26T15:42:36.026 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:36.027 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:36.027 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:36.027 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:02.200076Z", 2021-07-26T15:42:36.027 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:36.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:36.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:36.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:36.028 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:36.029 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:36.029 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:36.029 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:36.029 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:36.029 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:36.030 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:36.030 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:36.030 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:36.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:36.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:36.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:36.031 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:36.031 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:36.031 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:36.032 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:36.032 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:36.032 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:36.032 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:36.033 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:36.033 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:36.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:36.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:36.034 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:36.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:36.034 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:36.034 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:36.035 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:36.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:36.035 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:36.038 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314139.750935_74.1 target=1_1627314122.200076_61.1 2021-07-26T15:42:41.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.041 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:41.083 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:41.083 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:41.270 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:41.270 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:41.271 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:41.272 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:41.273 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.274 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.275 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:41.276 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.278 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314139.750935_74.1", 2021-07-26T15:42:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.279 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:19.750935Z", 2021-07-26T15:42:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.280 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:41.281 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.282 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:41.283 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.284 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.285 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.286 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:41.287 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.288 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:41.289 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:42:41.290 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:42:41.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.292 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:41.372 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:41.372 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:41.560 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:41.561 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:41.561 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:41.561 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:41.562 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:41.562 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:41.562 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.562 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:41.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.563 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:41.563 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.563 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.564 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:41.564 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.564 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:41.564 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.564 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:41.565 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.565 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.565 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:41.566 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.566 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.566 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314139.750935_74.1", 2021-07-26T15:42:41.566 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.567 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:41.567 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.567 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:19.750935Z", 2021-07-26T15:42:41.567 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.568 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:41.568 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.569 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.569 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:41.569 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.569 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:41.570 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.570 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:41.571 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.571 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:41.572 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:41.572 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:41.572 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:41.572 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:41.572 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:41.573 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:41.573 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:41.573 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:41.574 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:41.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.574 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:41.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:41.575 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:41.575 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:41.576 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:41.576 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:41.576 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:41.577 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:42:41.772 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.773 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:41.816 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:41.816 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:41.819 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:42:41.822+0000 7f9f38c36b00 -1 asok(0x55d12e570720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22439.asok': (13) Permission denied 2021-07-26T15:42:41.891 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:42:41.919 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:42:41.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:41.920 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:41.920 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:42:41.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:41.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:41.921 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:42:41.922 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:41.720968Z" 2021-07-26T15:42:41.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:41.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:41.923 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:41.923 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:41.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:41.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:41.925 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:41.926 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:41.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:42:41.927 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:42:41.928 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:42:41.929 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:41.930 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:41.973 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:42.167 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:42.167 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:42.167 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:42.168 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:42.168 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:42.168 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:42.168 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:42.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:42.169 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:42.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:42.169 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:42.169 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:42.170 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:42.170 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:42.170 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:42.170 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:42.171 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:42.171 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:42.171 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:42.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:42.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:42.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:42.172 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:42.173 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:42.180 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314139.750935_74.1", 2021-07-26T15:42:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:19.750935Z", 2021-07-26T15:42:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:42.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:42.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:42.183 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:42.183 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:42.184 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:42.184 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:42.184 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:42.184 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:42.185 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:42.185 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:42.185 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:42.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:42.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:42.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:42.186 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:42.186 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:42.187 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:42.187 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:42.187 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:42.188 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:42.188 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:42.188 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:42.188 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:42.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:42.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:42.189 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:42.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:42.189 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:42.190 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:42.190 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:42.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:42.190 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:42.192 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314161.720968_78.1 target=1_1627314139.750935_74.1 2021-07-26T15:42:47.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:47.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:47.195 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:47.239 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:47.240 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:47.435 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:47.435 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:47.436 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:47.437 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:47.438 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:47.439 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314139.750935_74.1", 2021-07-26T15:42:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:19.750935Z", 2021-07-26T15:42:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:47.444 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:47.445 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:47.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:47.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:47.446 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:47.446 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:47.447 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:47.447 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:47.447 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:47.447 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:47.447 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:47.448 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:47.448 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:47.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:47.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:47.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:47.450 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:47.454 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314161.720968_78.1 target=1_1627314139.750935_74.1 2021-07-26T15:42:52.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:52.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:52.458 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:52.503 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:52.503 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:52.686 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:52.687 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:52.687 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:52.687 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:52.688 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:52.688 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:52.689 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:52.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:52.691 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:52.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:52.692 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:52.693 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:52.693 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:52.693 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:52.694 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:52.694 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:52.694 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:52.695 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:52.695 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:52.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:52.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:52.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:52.696 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:52.696 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:52.697 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:52.697 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314139.750935_74.1", 2021-07-26T15:42:52.697 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:52.697 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:52.698 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:52.698 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:19.750935Z", 2021-07-26T15:42:52.698 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:52.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:52.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:52.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:52.699 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:52.699 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:52.699 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:52.700 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:52.700 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:52.701 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:52.701 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:52.701 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:52.701 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:52.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:52.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:52.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:52.702 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:52.702 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:52.703 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:52.703 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:52.703 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:52.703 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:52.704 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:52.704 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:52.704 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:52.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:52.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:52.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:52.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:52.705 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:52.706 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:52.706 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:52.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:52.706 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:52.709 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314161.720968_78.1 target=1_1627314139.750935_74.1 2021-07-26T15:42:57.710 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:57.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:57.711 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:57.947 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:57.947 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:57.948 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:57.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:57.951 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:57.952 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:57.953 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:57.954 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:57.955 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:57.956 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:57.957 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:57.958 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:57.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:57.960 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:57.963 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:42:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:57.964 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:41.720968Z", 2021-07-26T15:42:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:57.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:57.966 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:57.967 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:57.973 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:57.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:57.975 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:57.976 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:42:57.979 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:42:57.980 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:57.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:57.982 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:58.217 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:58.218 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:58.218 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:58.218 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:58.218 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:58.219 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:58.219 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:58.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:58.219 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:58.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:58.220 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:58.220 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:58.220 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:58.220 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:58.221 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:58.221 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:58.221 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:58.221 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:58.222 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:58.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:58.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:58.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:58.222 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:58.223 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:58.223 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:58.223 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:42:58.223 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:58.224 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:58.224 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:58.224 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:41.720968Z", 2021-07-26T15:42:58.224 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:58.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:58.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:58.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:58.226 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:58.226 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:58.226 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:58.226 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:58.227 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:58.227 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:58.227 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:58.227 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:58.227 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:58.228 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:58.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:58.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:58.228 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:58.229 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:58.230 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:58.230 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:58.231 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:58.231 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:58.231 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:58.231 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:58.231 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:58.232 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:58.232 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:58.232 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:58.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:58.233 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:58.233 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:58.235 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:58.236 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:58.236 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:58.238 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:42:58.254 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2021-07-26T15:42:58.256 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-7 2021-07-26T15:42:58.281 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-8 2021-07-26T15:42:58.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:58.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:58.737 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:58.788 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:58.791 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:42:58.790+0000 7f90719e4b00 -1 asok(0x55704026b720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22518.asok': (13) Permission denied 2021-07-26T15:42:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:42:58.878 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:42:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:39:46.247125Z" 2021-07-26T15:42:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:42:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:58.310641Z" 2021-07-26T15:42:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:42:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:42:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:42:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:42:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:42:58.884 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:42:58.885 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:42:58.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:58.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:58.888 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:58.931 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:58.931 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:59.127 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:42:59.127 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:42:59.127 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:42:59.128 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:42:59.128 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:42:59.128 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:42:59.128 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:59.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:59.129 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:42:59.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:59.129 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:42:59.130 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:59.130 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:59.130 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:42:59.130 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:59.131 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:42:59.131 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:59.131 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:42:59.131 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:59.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:59.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:59.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:59.132 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:42:59.132 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:59.135 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:59.135 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:42:59.135 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:59.135 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:59.136 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:59.136 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:41.720968Z", 2021-07-26T15:42:59.136 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:59.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:59.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:59.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:59.137 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:42:59.137 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:59.137 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:59.138 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:59.138 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:59.138 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:59.138 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:59.139 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:59.139 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:59.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:59.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:59.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:42:59.140 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:42:59.140 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:42:59.140 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:42:59.140 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:42:59.141 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:42:59.141 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:42:59.141 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:42:59.142 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:42:59.142 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:42:59.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:59.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:59.143 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:42:59.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:42:59.143 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:42:59.144 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:42:59.144 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:42:59.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:42:59.144 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:42:59.146 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314178.310641_86.1 target=1_1627314161.720968_78.1 2021-07-26T15:43:02.339 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:43:02.338+0000 7f75c77fe700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:02.339 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:43:02.338+0000 7f75c57fa700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:02.339 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:43:02.338+0000 7f75be7fc700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:02.389 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:43:02.390+0000 7f75b37e6700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:04.147 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:04.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:04.148 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:04.191 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:04.191 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:04.395 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:04.396 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:04.397 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:04.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:04.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:04.400 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:04.401 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:04.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:43:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:04.406 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:41.720968Z", 2021-07-26T15:43:04.407 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:04.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:04.409 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:04.410 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:04.411 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:04.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:04.413 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:04.414 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:04.415 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:04.416 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:04.417 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:04.417 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:04.419 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314178.310641_86.1 target=1_1627314161.720968_78.1 2021-07-26T15:43:09.420 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:09.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:09.422 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:09.466 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:09.466 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:41.720968Z", 2021-07-26T15:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:09.672 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314178.310641_86.1 target=1_1627314161.720968_78.1 2021-07-26T15:43:14.674 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.675 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:14.718 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:14.718 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:14.911 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:14.911 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:14.911 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:14.912 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:14.912 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:14.912 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:14.912 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:14.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:14.913 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:14.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:14.913 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:14.913 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:14.914 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:14.914 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:14.914 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:14.914 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:14.915 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:14.915 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:14.915 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:14.915 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:14.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:14.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:14.916 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:14.916 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:14.917 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:14.917 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314161.720968_78.1", 2021-07-26T15:43:14.917 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:14.917 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:14.918 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:14.918 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:41.720968Z", 2021-07-26T15:43:14.918 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:14.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:14.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:14.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:14.919 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:14.919 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:14.920 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:14.920 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:14.920 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:14.920 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:14.920 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:14.921 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:14.921 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:14.921 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:14.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:14.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:14.922 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:14.922 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:14.922 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:14.923 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:14.923 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:14.923 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:14.923 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:14.923 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:14.924 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:14.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:14.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:14.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:14.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:14.925 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:14.925 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:14.925 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:14.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:14.926 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:14.927 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=1 master=1_1627314178.310641_86.1 target=1_1627314161.720968_78.1 2021-07-26T15:43:17.150 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:43:17.150+0000 7f90ee7fc700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:17.153 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:43:17.154+0000 7f90effff700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:19.928 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.930 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:19.971 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:19.972 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.168 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:20.168 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:20.169 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:20.169 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:20.169 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:20.169 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:20.170 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.170 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:20.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.171 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:20.171 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.171 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.171 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:20.172 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.172 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:20.172 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.172 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:20.173 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.174 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:20.174 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.174 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.175 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:43:20.175 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.175 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:20.176 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.176 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.310641Z", 2021-07-26T15:43:20.176 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.177 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:20.177 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.177 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.178 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:20.178 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.180 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:20.180 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.181 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.181 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:20.181 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.181 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:20.182 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.182 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:20.182 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.185 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:20.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.185 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:20.185 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:20.186 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:20.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.186 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:20.188 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:43:20.189 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:43:20.189 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.191 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:20.272 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:20.272 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.455 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:20.455 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:20.455 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:20.456 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:20.456 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:20.456 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:20.456 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.457 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:20.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.457 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:20.458 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.458 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.458 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:20.459 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.459 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:20.460 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.460 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:20.460 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.461 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:20.461 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.462 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.462 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:43:20.462 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.463 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:20.463 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.463 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.310641Z", 2021-07-26T15:43:20.463 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.464 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:20.464 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.465 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.465 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:20.465 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.466 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:20.466 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.467 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:20.467 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:20.468 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:20.468 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:20.468 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:20.468 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:20.469 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:20.469 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:20.469 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:20.469 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:20.470 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:20.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.471 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.471 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:20.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:20.472 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:20.472 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:20.472 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:20.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:20.473 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:20.474 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:43:20.475 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:20.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:20.476 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-7 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:20.524 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:20.525 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.699 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:20.698+0000 7fb728456b00 1 bucket sync caught up with source: 2021-07-26T15:43:20.699 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , 00000000001.9.5, , , , 00000000001.7.5, 00000000001.3.5, , ] 2021-07-26T15:43:20.699 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000001.7.5, , 00000000001.9.5, , , , 00000000001.7.5, 00000000001.3.5, , ] 2021-07-26T15:43:20.699 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:20.698+0000 7fb728456b00 0 bucket checkpoint complete 2021-07-26T15:43:20.730 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-7 zones={test-zone2, test-zone1} 2021-07-26T15:43:20.739 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:20.789 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:43:20.789 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:43:20.790 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:43:20.790 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:20.791 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:20.797 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:43:20.797 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:43:20.798 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:43:20.798 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:20.854 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:43:20.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:43:21.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:43:21.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:43:21.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:43:21.288 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:43:21.397 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:43:21.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:43:21.570 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:43:21.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:21.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:21.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:21.953 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-7 zones={test-zone2, test-zone1} 2021-07-26T15:43:21.953 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:21.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:21.955 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-7 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:22.004 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.005 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:22.178 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:22.170+0000 7fe959045b00 1 bucket sync caught up with source: 2021-07-26T15:43:22.178 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , 00000000001.9.5, , , , 00000000001.7.5, 00000000001.3.5, , ] 2021-07-26T15:43:22.178 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000001.7.5, , 00000000001.9.5, , , , 00000000001.7.5, 00000000001.3.5, , ] 2021-07-26T15:43:22.179 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:22.170+0000 7fe959045b00 0 bucket checkpoint complete 2021-07-26T15:43:22.202 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:22.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:22.207 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-8 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.266 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:22.269 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:22.269+0000 7fc20343bb00 -1 asok(0x55dd94d93720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22594.asok': (13) Permission denied 2021-07-26T15:43:22.365 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:22.365+0000 7fc20343bb00 1 bucket sync caught up with source: 2021-07-26T15:43:22.366 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000001.8.5, , 00000000001.6.5, , , , 00000000001.5.5, 00000000001.8.5, , ] 2021-07-26T15:43:22.366 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000001.8.5, , 00000000001.6.5, , , , 00000000001.5.5, 00000000001.8.5, , ] 2021-07-26T15:43:22.366 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:22.365+0000 7fc20343bb00 0 bucket checkpoint complete 2021-07-26T15:43:22.394 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-8 zones={test-zone1, test-zone2} 2021-07-26T15:43:22.404 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:22.456 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:43:22.457 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:43:22.457 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:43:22.457 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:22.458 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:22.464 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:43:22.464 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:43:22.465 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:43:22.465 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:22.519 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:43:22.575 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:43:22.683 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:43:22.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:43:22.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:43:22.971 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:43:23.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:43:23.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:43:23.247 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:43:23.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:23.415 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:23.531 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:23.639 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-8 zones={test-zone1, test-zone2} 2021-07-26T15:43:23.640 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2021-07-26T15:43:23.641 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-9 2021-07-26T15:43:23.666 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-10 2021-07-26T15:43:23.807 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:23.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:23.808 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:23.854 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:23.854 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:23.857+0000 7fa384326b00 -1 asok(0x55738ac1b720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22672.asok': (13) Permission denied 2021-07-26T15:43:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:43:23.967 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:43:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:43:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:43:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.693366Z" 2021-07-26T15:43:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:43:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:43:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:43:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:43:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:43:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:43:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:43:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:43:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:43:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:43:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:43:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:43:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:43:23.973 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:43:23.974 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:43:23.974 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:23.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:23.975 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:24.017 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:24.017 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:24.211 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:24.215 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:24.215 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:24.215 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:24.216 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:24.216 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:24.216 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:24.216 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:24.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:24.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:24.217 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:24.217 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:24.217 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:24.218 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:43:24.218 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:24.218 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:24.219 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:24.219 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.310641Z", 2021-07-26T15:43:24.219 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:24.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:24.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:24.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:24.220 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:24.220 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:24.220 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:24.220 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:24.221 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:24.221 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:24.221 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:24.221 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:24.222 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:24.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:24.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:24.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:24.222 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:24.223 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:24.223 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:24.223 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:24.223 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:24.224 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:24.224 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:24.224 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:24.224 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:24.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:24.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:24.225 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:24.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:24.225 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:24.225 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:24.226 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:24.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:24.226 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:24.226 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314203.693366_67.1 target=1_1627313986.247125_58.1, shard=1 master=1_1627314203.666519_93.1 target=1_1627314178.310641_86.1 2021-07-26T15:43:29.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:29.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:29.230 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:29.281 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:29.281 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:29.470 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:29.471 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:29.471 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:29.471 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:29.471 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:29.472 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:29.472 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:29.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:29.472 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:29.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:43:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:29.477 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:29.477 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.310641Z", 2021-07-26T15:43:29.477 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:29.477 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:29.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:29.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:29.478 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:29.478 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:29.479 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:29.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:29.482 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:29.482 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:29.482 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:29.482 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:29.483 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:29.483 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:29.484 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:29.484 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:29.484 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:29.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:29.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:29.485 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:29.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:29.485 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:29.485 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:29.486 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:29.486 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:29.486 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:29.488 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314203.693366_67.1 target=1_1627313986.247125_58.1, shard=1 master=1_1627314203.666519_93.1 target=1_1627314178.310641_86.1 2021-07-26T15:43:34.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:34.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:34.491 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:34.532 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:34.533 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:34.728 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:43:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.310641Z", 2021-07-26T15:43:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:34.738 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:34.739 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:34.740 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:34.747 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:34.748 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314203.693366_67.1 target=1_1627313986.247125_58.1, shard=1 master=1_1627314203.666519_93.1 target=1_1627314178.310641_86.1 2021-07-26T15:43:37.141 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:43:37.140+0000 7f90fdffb700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:39.750 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:39.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:39.752 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:39.795 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:39.795 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:39.992 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:43:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.693366Z", 2021-07-26T15:43:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:43:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:43:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.007 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:40.008 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:43:40.008 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:43:40.009 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:40.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:40.010 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:40.095 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:40.095 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:40.286 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:40.286 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:40.287 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:40.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:40.289 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627313986.247125_58.1", 2021-07-26T15:43:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:40.290 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:39:46.247125Z", 2021-07-26T15:43:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314178.310641_86.1", 2021-07-26T15:43:40.292 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:40.293 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.310641Z", 2021-07-26T15:43:40.294 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:40.295 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:40.295 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:40.295 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:40.296 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:40.296 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:40.296 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:40.296 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:40.297 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:40.297 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:40.298 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:40.298 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:40.298 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:40.298 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:40.299 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:40.299 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:40.299 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:40.299 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:40.300 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:40.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.300 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.301 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:40.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:40.301 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:40.301 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:40.301 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:40.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:40.302 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:40.304 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314203.693366_67.1 target=1_1627313986.247125_58.1, shard=1 master=1_1627314203.666519_93.1 target=1_1627314178.310641_86.1 2021-07-26T15:43:42.347 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:43:42.343+0000 7f75b5feb700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:42.448 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:43:42.447+0000 7f75bb7f6700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:45.305 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:45.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:45.306 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:45.348 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:45.348 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:45.552 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:43:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:43:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:43:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:43:45.553 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:43:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:43:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:45.554 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:43:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:43:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:45.555 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:43:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:43:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:45.556 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.693366Z", 2021-07-26T15:43:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:45.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:43:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:43:45.558 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:45.560 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:43:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:45.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:43:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:45.562 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:45.563 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:43:45.564 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:43:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:43:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:43:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:43:45.565 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:43:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:43:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:43:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:43:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:43:45.566 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:43:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:43:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:43:45.567 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:43:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:43:45.568 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:43:45.568 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:43:45.570 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:43:45.570 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:45.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:45.571 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:45.655 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:45.655 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:45.835 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:45.831+0000 7f568099bb00 1 bucket sync caught up with source: 2021-07-26T15:43:45.835 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:45.836 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:45.831+0000 7f568099bb00 0 bucket checkpoint complete 2021-07-26T15:43:45.865 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-9 zones={test-zone2, test-zone1} 2021-07-26T15:43:45.874 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:45.923 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:45.924 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:45.932 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:46.006 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:46.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:46.177 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:46.284 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-9 zones={test-zone2, test-zone1} 2021-07-26T15:43:46.285 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:46.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:46.286 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:46.333 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:46.334 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:46.503 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:46.498+0000 7fb40534cb00 1 bucket sync caught up with source: 2021-07-26T15:43:46.503 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:46.503 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:46.504 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:46.498+0000 7fb40534cb00 0 bucket checkpoint complete 2021-07-26T15:43:46.531 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:46.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:46.533 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:46.582 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:46.583 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:46.586 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:46.586+0000 7ff58c4d5b00 -1 asok(0x55a9a828a720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22762.asok': (13) Permission denied 2021-07-26T15:43:46.683 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:46.682+0000 7ff58c4d5b00 1 bucket sync caught up with source: 2021-07-26T15:43:46.684 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:46.684 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:46.685 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:43:46.682+0000 7ff58c4d5b00 0 bucket checkpoint complete 2021-07-26T15:43:46.713 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-10 zones={test-zone1, test-zone2} 2021-07-26T15:43:46.723 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:46.775 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:46.776 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:46.782 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:43:46.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:46.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:47.013 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:43:47.117 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-10 zones={test-zone1, test-zone2} 2021-07-26T15:43:47.135 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:47.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:43:47.136 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:43:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:47.185 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:47.358+0000 7fd5a1ed4b00 1 waiting for incremental sync to catch up: 2021-07-26T15:43:47.363 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:47.364 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:43:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:52.366+0000 7fd5a1ed4b00 1 waiting for incremental sync to catch up: 2021-07-26T15:43:52.369 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:52.369 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:43:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:43:57.369+0000 7fd5a1ed4b00 1 waiting for incremental sync to catch up: 2021-07-26T15:43:57.369 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:43:57.369 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:02.369+0000 7fd5a1ed4b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:02.373 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:44:02.374 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:07.375 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:07.372+0000 7fd5a1ed4b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:07.376 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:44:07.376 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:12.378 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:12.376+0000 7fd5a1ed4b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:12.379 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2021-07-26T15:44:12.380 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:17.381 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:17.375+0000 7fd5a1ed4b00 1 bucket sync caught up with source: 2021-07-26T15:44:17.497 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:17.497 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:17.497 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:17.375+0000 7fd5a1ed4b00 0 bucket checkpoint complete 2021-07-26T15:44:17.499 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-9 zones={test-zone2, test-zone1} 2021-07-26T15:44:17.511 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:44:17.559 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:44:17.616 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-9 zones={test-zone2, test-zone1} 2021-07-26T15:44:17.617 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:44:17.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:44:17.619 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:44:17.662 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:17.662 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:17.850 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:17.847+0000 7fd3ad419b00 1 bucket sync caught up with source: 2021-07-26T15:44:17.851 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:17.853 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000002.9.5, , , , , , , , , ] 2021-07-26T15:44:17.853 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:17.847+0000 7fd3ad419b00 0 bucket checkpoint complete 2021-07-26T15:44:17.898 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:44:17.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:44:17.899 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:44:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:44:17.949+0000 7f516db9bb00 -1 asok(0x5638ffe13720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22840.asok': (13) Permission denied 2021-07-26T15:44:18.043 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:44:18.041+0000 7f516db9bb00 1 bucket sync caught up with source: 2021-07-26T15:44:18.044 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000002.10.5, , , , , , , , , ] 2021-07-26T15:44:18.044 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000002.10.5, , , , , , , , , ] 2021-07-26T15:44:18.044 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:44:18.041+0000 7f516db9bb00 0 bucket checkpoint complete 2021-07-26T15:44:18.067 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-10 zones={test-zone1, test-zone2} 2021-07-26T15:44:18.075 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:44:18.123 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:44:18.184 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-10 zones={test-zone1, test-zone2} 2021-07-26T15:44:18.185 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2021-07-26T15:44:18.185 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-11 2021-07-26T15:44:18.211 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-12 2021-07-26T15:44:18.285 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:18.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:18.286 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:18.327 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:18.328 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:18.332 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:44:18.329+0000 7f966c7d3b00 -1 asok(0x55c520880720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.22930.asok': (13) Permission denied 2021-07-26T15:44:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:44:18.442 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:44:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:44:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314258.279311_82.1", 2021-07-26T15:44:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:44:18.279311Z" 2021-07-26T15:44:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:44:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:44:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:44:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:44:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:44:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:44:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:44:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:44:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:44:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:44:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:44:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:44:18.446 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:44:18.447 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:44:18.448 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:18.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:18.449 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:18.491 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:18.492 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:18.683 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:44:18.683 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:44:18.684 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:44:18.684 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:44:18.684 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:44:18.684 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:44:18.685 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:18.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:18.685 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:44:18.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:18.685 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:44:18.686 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:18.686 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:18.686 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:44:18.687 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:18.687 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:44:18.687 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:18.687 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.693366Z", 2021-07-26T15:44:18.688 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:18.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:18.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:18.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:18.690 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:44:18.690 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:18.690 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:18.690 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:18.691 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:18.691 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:18.691 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:18.691 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:44:18.692 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:18.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:18.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:18.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:18.693 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:44:18.693 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:18.693 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:18.693 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:18.694 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:18.694 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:18.694 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:18.694 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:18.695 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:18.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:18.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:18.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:18.696 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:44:18.696 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:18.696 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:18.697 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:18.697 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:18.698 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:18.698 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:18.698 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:18.699 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:18.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:18.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:18.700 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:44:18.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:18.701 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:44:18.701 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:44:18.701 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:44:18.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:18.702 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:44:18.703 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314258.279311_82.1 target=1_1627314203.693366_67.1 2021-07-26T15:44:23.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:23.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:23.705 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:23.748 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:23.749 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:44:23.943 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:44:23.944 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:44:23.944 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:44:23.944 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:44:23.944 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:44:23.944 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:23.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:23.945 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:44:23.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:23.945 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:44:23.946 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:23.946 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:23.946 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:44:23.946 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:23.947 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:44:23.947 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:23.947 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.693366Z", 2021-07-26T15:44:23.947 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:23.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:23.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:23.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:23.948 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:44:23.948 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:23.949 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:23.949 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:23.949 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:23.949 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:23.950 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:23.950 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:44:23.950 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:23.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:23.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:23.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:23.951 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:44:23.951 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:23.951 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:23.952 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:23.952 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:23.952 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:23.952 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:23.953 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:23.953 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:23.953 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:23.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:23.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:23.954 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:44:23.954 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:23.954 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:23.954 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:23.955 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:23.955 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:23.955 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:23.955 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:23.955 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:23.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:23.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:23.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:44:23.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:23.958 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:44:23.958 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:44:23.958 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:44:23.959 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:44:23.960 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314258.279311_82.1 target=1_1627314203.693366_67.1 2021-07-26T15:44:28.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:28.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:28.964 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:29.011 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:29.012 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:29.210 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:44:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:44:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:44:29.211 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:44:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:44:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:44:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:29.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:44:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:44:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:29.213 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:44:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:44:29.214 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.693366Z", 2021-07-26T15:44:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:29.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:44:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:29.216 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:44:29.217 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:29.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:44:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:29.219 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:29.220 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:29.221 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:44:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:29.222 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:29.223 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:44:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:44:29.224 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:44:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:44:29.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:29.225 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:44:29.226 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314258.279311_82.1 target=1_1627314203.693366_67.1 2021-07-26T15:44:34.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:34.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:34.229 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:34.269 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:34.269 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:34.473 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:44:34.473 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:44:34.474 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:44:34.474 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:44:34.474 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:44:34.474 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:44:34.474 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:34.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:34.475 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:44:34.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:34.475 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:44:34.476 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:34.476 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:34.476 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.693366_67.1", 2021-07-26T15:44:34.476 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:34.477 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:44:34.477 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:34.477 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.693366Z", 2021-07-26T15:44:34.477 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:34.478 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:34.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:34.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:34.478 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:44:34.479 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:34.479 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:34.479 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:34.479 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:34.480 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:34.480 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:34.480 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:44:34.481 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:34.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:34.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:34.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:34.481 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:44:34.482 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:34.483 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:34.483 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:34.483 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:34.483 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:34.484 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:34.484 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:34.484 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:34.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:34.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:34.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:34.485 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:44:34.485 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:34.486 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:34.486 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:34.486 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:34.487 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:34.487 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:34.487 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:34.487 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:34.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:34.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:34.488 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:44:34.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:34.489 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:44:34.489 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:44:34.489 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:44:34.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:34.489 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:44:34.491 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314258.279311_82.1 target=1_1627314203.693366_67.1 2021-07-26T15:44:39.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:39.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:39.494 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:39.535 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:39.536 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:39.707 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:44:39.707 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:44:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:44:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:44:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:44:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:44:39.708 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:44:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.709 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:44:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314258.279311_82.1", 2021-07-26T15:44:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.710 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:44:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:44:18.279311Z", 2021-07-26T15:44:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.713 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:44:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.714 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.715 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:44:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.716 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:44:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:39.717 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:44:39.719 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:44:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:44:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:44:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:44:39.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.723 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:44:39.724 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:44:39.725 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:44:39.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:39.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:39.727 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:39.767 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:39.768 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:39.961 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:44:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:44:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:44:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:44:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:44:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:44:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:44:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:44:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314258.279311_82.1", 2021-07-26T15:44:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:44:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:44:18.279311Z", 2021-07-26T15:44:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:44:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:44:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:44:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:44:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:44:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:44:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:44:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:44:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:44:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:44:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:44:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:44:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:44:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:44:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:44:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:44:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:44:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:44:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:44:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:44:39.975 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:44:39.976 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:44:40.031 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:44:40.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:44:40.033 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:44:40.083 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:40.084 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:40.266 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:40.258+0000 7f1762b64b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:40.266 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:44:40.266 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:44:45.268 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:45.262+0000 7f1762b64b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:45.269 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:44:45.269 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:44:50.271 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:50.266+0000 7f1762b64b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:50.271 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:44:50.271 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:44:55.274 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:44:55.270+0000 7f1762b64b00 1 waiting for incremental sync to catch up: 2021-07-26T15:44:55.274 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:44:55.275 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:00.277 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:00.273+0000 7f1762b64b00 1 bucket sync caught up with source: 2021-07-26T15:45:00.277 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:00.278 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:00.278 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:00.273+0000 7f1762b64b00 0 bucket checkpoint complete 2021-07-26T15:45:00.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:00.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:00.309 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:00.360 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:00.360 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:00.533 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:00.529+0000 7f30cde3bb00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:00.534 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:00.534 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:45:05.536 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:05.533+0000 7f30cde3bb00 1 bucket sync caught up with source: 2021-07-26T15:45:05.537 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:45:05.537 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:45:05.537 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:05.533+0000 7f30cde3bb00 0 bucket checkpoint complete 2021-07-26T15:45:05.623 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:05.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:05.625 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:05.684 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:05.688 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:05.684+0000 7f64a0703b00 -1 asok(0x55db51282720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23010.asok': (13) Permission denied 2021-07-26T15:45:05.777 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:05.772+0000 7f64a0703b00 1 bucket sync caught up with source: 2021-07-26T15:45:05.778 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , 00000000002.20.10, , , , , ] 2021-07-26T15:45:05.778 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , 00000000002.20.10, , , , , ] 2021-07-26T15:45:05.779 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:05.772+0000 7f64a0703b00 0 bucket checkpoint complete 2021-07-26T15:45:06.519 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:06.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:06.521 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:06.570 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:06.571 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:06.759 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:06.753+0000 7fee6268eb00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:06.759 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:06.760 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:11.757+0000 7fee6268eb00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:11.762 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:11.762 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:16.764 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:16.761+0000 7fee6268eb00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:16.765 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:45:16.765 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:21.768 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:21.765+0000 7fee6268eb00 1 bucket sync caught up with source: 2021-07-26T15:45:21.768 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:21.768 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:21.769 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:21.765+0000 7fee6268eb00 0 bucket checkpoint complete 2021-07-26T15:45:21.797 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:21.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:21.799 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:21.845 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:21.846 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:22.017 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:22.013+0000 7f01d2c05b00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:22.018 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:45:22.018 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:27.020 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:27.017+0000 7f01d2c05b00 1 bucket sync caught up with source: 2021-07-26T15:45:27.021 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:27.021 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:27.021 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:27.017+0000 7f01d2c05b00 0 bucket checkpoint complete 2021-07-26T15:45:27.049 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:27.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:27.050 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:27.100 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:27.101 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:27.104 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:27.100+0000 7fd8d4ffcb00 -1 asok(0x55a0a25e3720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23089.asok': (13) Permission denied 2021-07-26T15:45:27.205 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:27.200+0000 7fd8d4ffcb00 1 bucket sync caught up with source: 2021-07-26T15:45:27.206 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000002.6.10, , 00000000010.31.5, , 00000000002.16.10, , , , , ] 2021-07-26T15:45:27.206 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000002.6.10, , 00000000010.31.5, , 00000000002.16.10, , , , , ] 2021-07-26T15:45:27.206 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:27.200+0000 7fd8d4ffcb00 0 bucket checkpoint complete 2021-07-26T15:45:27.236 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-11 zones={test-zone2, test-zone1} 2021-07-26T15:45:27.246 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:45:27.295 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:27.296 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:27.296 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:27.297 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:45:27.304 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:27.304 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:27.305 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:27.317 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:27.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:27.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:27.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:27.513 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:27.630 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:27.740 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:27.802 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:27.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:28.027 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-11 zones={test-zone2, test-zone1} 2021-07-26T15:45:28.028 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:28.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:28.030 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:28.081 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:28.081 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:28.272 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:28.269+0000 7f6280988b00 1 bucket sync caught up with source: 2021-07-26T15:45:28.273 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.34.5, , 00000000006.18.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:28.273 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.34.5, , 00000000006.18.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:28.274 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:28.269+0000 7f6280988b00 0 bucket checkpoint complete 2021-07-26T15:45:28.294 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:28.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:28.298 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:28.344 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:28.345 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:28.516 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:28.513+0000 7f9b87a7ab00 1 bucket sync caught up with source: 2021-07-26T15:45:28.517 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.34.5, , 00000000006.18.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:28.517 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000010.34.5, , 00000000006.18.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:28.517 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:28.513+0000 7f9b87a7ab00 0 bucket checkpoint complete 2021-07-26T15:45:28.550 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:28.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:28.552 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:28.601 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:28.602 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:28.605 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:28.600+0000 7fd44ee1fb00 -1 asok(0x562e8b386720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23167.asok': (13) Permission denied 2021-07-26T15:45:28.697 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:28.692+0000 7fd44ee1fb00 1 bucket sync caught up with source: 2021-07-26T15:45:28.697 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000002.26.10, , 00000000010.33.5, , 00000000003.22.9, , , , , ] 2021-07-26T15:45:28.698 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000002.26.10, , 00000000010.33.5, , 00000000003.22.9, , , , , ] 2021-07-26T15:45:28.698 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:28.692+0000 7fd44ee1fb00 0 bucket checkpoint complete 2021-07-26T15:45:28.726 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-12 zones={test-zone2, test-zone1} 2021-07-26T15:45:28.736 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:45:28.787 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:28.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:28.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:28.789 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:45:28.795 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:28.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:28.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:28.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:28.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:28.937 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:29.001 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:29.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:29.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:29.281 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:29.341 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:29.458 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:29.565 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-12 zones={test-zone2, test-zone1} 2021-07-26T15:45:29.840 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:29.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:29.843 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:29.895 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:29.895 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:30.059 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:30.053+0000 7fbbd5bf0b00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:30.059 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:30.059 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:35.060 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:35.057+0000 7fbbd5bf0b00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:35.060 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:35.061 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:40.070 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:40.056+0000 7fbbd5bf0b00 1 bucket sync caught up with source: 2021-07-26T15:45:40.079 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:40.080 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:40.080 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:40.056+0000 7fbbd5bf0b00 0 bucket checkpoint complete 2021-07-26T15:45:40.096 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:40.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:40.097 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:40.155 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:40.156 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:40.337 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:40.332+0000 7fb2cbddfb00 1 waiting for incremental sync to catch up: 2021-07-26T15:45:40.337 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000010.20.5, , 00000000006.16.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:40.338 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:45.340 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:45.336+0000 7fb2cbddfb00 1 bucket sync caught up with source: 2021-07-26T15:45:45.340 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:45.341 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.24.5, , 00000000007.19.5, , 00000000003.10.9, , , , , ] 2021-07-26T15:45:45.341 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:45.336+0000 7fb2cbddfb00 0 bucket checkpoint complete 2021-07-26T15:45:45.372 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:45.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:45.373 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-11 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:45.422 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:45.422 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:45.419+0000 7fcc206a7b00 -1 asok(0x55d474a5e720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23245.asok': (13) Permission denied 2021-07-26T15:45:45.522 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:45.515+0000 7fcc206a7b00 1 bucket sync caught up with source: 2021-07-26T15:45:45.522 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000003.9.5, , 00000000011.35.5, , 00000000002.16.10, , , , , ] 2021-07-26T15:45:45.522 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000003.9.5, , 00000000011.35.5, , 00000000002.16.10, , , , , ] 2021-07-26T15:45:45.523 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:45.515+0000 7fcc206a7b00 0 bucket checkpoint complete 2021-07-26T15:45:45.552 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-11 zones={test-zone2, test-zone1} 2021-07-26T15:45:45.561 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:45:45.566 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:45.566 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:45.567 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:45.567 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:45:45.572 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:45.573 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:45.573 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:45.628 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:45.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:45.706 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:45.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:45.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:45.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:46.085 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:46.146 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:46.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:46.386 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-11 zones={test-zone2, test-zone1} 2021-07-26T15:45:46.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:46.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:46.389 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:46.441 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:46.441 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:46.608 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:46.604+0000 7faf367a0b00 1 bucket sync caught up with source: 2021-07-26T15:45:46.609 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000011.38.5, , 00000000007.21.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:46.609 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.38.5, , 00000000007.21.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:46.609 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:46.604+0000 7faf367a0b00 0 bucket checkpoint complete 2021-07-26T15:45:46.633 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:46.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:46.635 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:46.679 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:46.680 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:46.866 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:46.860+0000 7f6b19107b00 1 bucket sync caught up with source: 2021-07-26T15:45:46.867 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, 00000000011.38.5, , 00000000007.21.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:46.867 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, 00000000011.38.5, , 00000000007.21.5, , 00000000002.14.10, , , , , ] 2021-07-26T15:45:46.867 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:45:46.860+0000 7f6b19107b00 0 bucket checkpoint complete 2021-07-26T15:45:46.895 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:46.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-12', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:45:46.897 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-12 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:45:46.946 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:46.946 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:46.949 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:46.943+0000 7f6e30b09b00 -1 asok(0x55badc5da720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23323.asok': (13) Permission denied 2021-07-26T15:45:47.045 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:47.039+0000 7f6e30b09b00 1 bucket sync caught up with source: 2021-07-26T15:45:47.046 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, 00000000003.29.5, , 00000000011.37.5, , 00000000003.22.9, , , , , ] 2021-07-26T15:45:47.046 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, 00000000003.29.5, , 00000000011.37.5, , 00000000003.22.9, , , , , ] 2021-07-26T15:45:47.046 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:47.039+0000 7f6e30b09b00 0 bucket checkpoint complete 2021-07-26T15:45:47.075 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-12 zones={test-zone2, test-zone1} 2021-07-26T15:45:47.085 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:45:47.135 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:47.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:47.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:47.137 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:45:47.144 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:45:47.146 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:45:47.147 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:45:47.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:47.170 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:47.241 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:45:47.300 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:47.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:47.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:45:47.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:47.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:47.755 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:45:47.860 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-12 zones={test-zone2, test-zone1} 2021-07-26T15:45:47.861 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2021-07-26T15:45:47.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:47.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:47.893 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:47.931 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:47.931 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:45:47.927+0000 7f3d5d8aab00 -1 asok(0x563092bef720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23403.asok': (13) Permission denied 2021-07-26T15:45:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:45:48.036 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:45:48.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:45:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314347.889594_90.1", 2021-07-26T15:45:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:45:47.889594Z" 2021-07-26T15:45:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:45:48.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:45:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:45:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:45:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:45:48.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:45:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:45:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:45:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:45:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:45:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:45:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:45:48.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:45:48.040 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:45:48.041 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:45:48.043 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:48.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:48.044 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:48.089 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:48.090 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:48.276 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:45:48.276 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:45:48.276 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:45:48.277 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:45:48.277 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:45:48.277 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:45:48.278 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:48.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:48.278 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:45:48.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:48.279 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:45:48.279 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:48.279 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:48.279 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314258.279311_82.1", 2021-07-26T15:45:48.280 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:48.280 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:45:48.280 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:48.280 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:44:18.279311Z", 2021-07-26T15:45:48.280 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:48.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:48.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:48.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:48.281 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:45:48.282 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:48.282 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:48.282 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:45:48.282 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:48.282 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:48.283 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:48.283 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:45:48.283 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:48.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:48.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:48.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:48.284 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:45:48.284 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:48.284 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:48.285 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:48.286 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:48.286 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:48.287 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:48.287 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:48.287 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:48.287 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:48.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:48.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:48.288 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:45:48.288 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:48.289 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:48.289 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:48.289 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:48.289 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:48.289 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:48.290 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:48.290 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:48.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:48.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:48.291 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:45:48.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:48.291 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:45:48.291 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:45:48.291 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:45:48.292 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:48.292 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:45:48.293 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314347.889594_90.1 target=1_1627314258.279311_82.1 2021-07-26T15:45:53.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:53.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:53.298 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:53.340 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:53.340 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:53.540 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:45:53.541 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:45:53.541 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:45:53.541 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:45:53.541 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:45:53.542 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:45:53.542 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:53.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:53.542 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:45:53.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:53.543 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:45:53.543 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:53.543 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:53.543 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314258.279311_82.1", 2021-07-26T15:45:53.544 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:53.544 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:45:53.544 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:53.544 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:44:18.279311Z", 2021-07-26T15:45:53.544 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:53.545 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:53.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:53.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:53.545 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:45:53.546 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:53.546 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:53.546 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:45:53.546 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:53.546 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:53.547 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:53.547 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:45:53.547 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:53.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:53.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:53.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:53.548 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:45:53.548 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:53.548 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:53.549 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:53.549 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:53.549 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:53.550 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:53.550 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:53.550 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:53.550 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:53.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:53.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:53.551 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:45:53.551 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:53.551 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:53.552 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:53.552 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:53.552 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:53.552 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:53.552 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:53.553 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:53.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:53.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:53.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:45:53.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:53.554 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:45:53.554 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:45:53.554 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:45:53.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:53.555 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:45:53.556 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314347.889594_90.1 target=1_1627314258.279311_82.1 2021-07-26T15:45:58.557 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:58.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:58.559 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:58.600 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:58.601 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:58.796 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:45:58.796 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:45:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:45:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:45:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:45:58.797 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:45:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:45:58.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:45:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314347.889594_90.1", 2021-07-26T15:45:58.799 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:45:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:45:47.889594Z", 2021-07-26T15:45:58.800 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:58.801 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:45:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:58.802 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:45:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:58.803 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:45:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:58.804 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:45:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:58.805 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:58.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:45:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:58.809 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:58.810 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:45:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:45:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:45:58.811 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:45:58.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:58.812 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:45:58.813 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:45:58.814 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:45:58.814 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:58.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:58.815 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:59.058 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:45:59.059 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:45:59.059 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:45:59.059 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:45:59.060 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:45:59.060 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:45:59.060 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:59.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:59.060 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:45:59.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:59.061 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:45:59.061 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:59.061 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:59.062 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314258.279311_82.1", 2021-07-26T15:45:59.062 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:59.062 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:45:59.062 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:59.062 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:44:18.279311Z", 2021-07-26T15:45:59.063 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:59.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:59.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:59.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:59.064 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:45:59.064 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:59.064 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:59.064 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:45:59.064 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:59.065 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:59.065 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:59.065 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:45:59.065 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:59.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:59.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:59.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:59.067 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:45:59.067 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:59.068 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:59.068 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:59.068 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:59.068 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:59.068 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:59.069 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:59.069 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:59.069 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:59.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:59.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:45:59.070 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:45:59.070 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:45:59.070 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:45:59.070 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:45:59.071 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:45:59.071 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:45:59.071 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:45:59.071 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:45:59.072 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:45:59.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:59.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:59.073 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:45:59.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:45:59.073 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:45:59.073 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:45:59.074 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:45:59.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:45:59.074 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:45:59.075 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314347.889594_90.1 target=1_1627314258.279311_82.1 2021-07-26T15:46:04.077 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:04.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:04.078 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:04.315 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:46:04.315 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:46:04.316 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:46:04.316 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:46:04.316 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:46:04.316 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:46:04.316 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:04.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:04.317 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:46:04.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:04.317 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:46:04.318 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:04.318 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:04.318 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314347.889594_90.1", 2021-07-26T15:46:04.318 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:04.318 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:46:04.319 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:04.319 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:45:47.889594Z", 2021-07-26T15:46:04.319 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:04.319 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:04.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:04.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:04.320 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:46:04.321 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:04.321 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:04.321 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:46:04.321 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:04.322 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:04.322 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:04.322 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:46:04.323 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:04.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:04.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:04.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:04.324 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:46:04.324 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:04.324 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:04.324 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:46:04.324 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:04.325 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:04.325 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:04.325 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:46:04.325 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:04.326 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:04.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:04.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:04.326 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:46:04.326 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:04.327 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:04.327 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:46:04.327 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:04.327 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:04.328 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:04.328 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:46:04.328 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:04.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:04.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:04.329 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:46:04.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:04.329 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:46:04.329 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:46:04.329 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:46:04.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:04.330 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:46:04.331 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:46:04.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:04.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:04.384 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:46:04.431 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:04.432 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:04.620 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:04.616+0000 7f1a76020b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:04.620 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:46:04.620 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:09.622 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:09.616+0000 7f1a76020b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:09.623 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:46:09.623 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:14.627 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:14.620+0000 7f1a76020b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:14.627 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:46:14.628 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:19.626 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:19.620+0000 7f1a76020b00 1 bucket sync caught up with source: 2021-07-26T15:46:19.626 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:19.627 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:19.627 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:19.620+0000 7f1a76020b00 0 bucket checkpoint complete 2021-07-26T15:46:19.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:19.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:19.656 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:46:19.702 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:19.702 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:19.875 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:19.872+0000 7fe7422cab00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:19.876 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:46:19.876 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:46:24.878 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:24.872+0000 7fe7422cab00 1 bucket sync caught up with source: 2021-07-26T15:46:24.879 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:46:24.879 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:46:24.879 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:24.872+0000 7fe7422cab00 0 bucket checkpoint complete 2021-07-26T15:46:24.907 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:24.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:24.908 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:46:24.960 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:24.960 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:24.964 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:24.962+0000 7fa1626aeb00 -1 asok(0x561610c2f720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23479.asok': (13) Permission denied 2021-07-26T15:46:25.063 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:25.058+0000 7fa1626aeb00 1 bucket sync caught up with source: 2021-07-26T15:46:25.064 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , 00000000002.16.10, , , , , ] 2021-07-26T15:46:25.064 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , 00000000002.16.10, , , , , ] 2021-07-26T15:46:25.064 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:25.058+0000 7fa1626aeb00 0 bucket checkpoint complete 2021-07-26T15:46:25.093 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-13 zones={test-zone2, test-zone1} 2021-07-26T15:46:25.102 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:46:25.151 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:46:25.152 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:46:25.160 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:46:25.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:46:25.225 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:46:25.300 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:46:25.366 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-13 zones={test-zone2, test-zone1} 2021-07-26T15:46:26.403 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:26.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:26.404 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:46:26.453 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:26.453 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:26.628 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:26.624+0000 7f160a0d1b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:26.628 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:26.628 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:31.630 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:31.623+0000 7f160a0d1b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:31.631 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:31.631 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:36.636 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:36.627+0000 7f160a0d1b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:36.636 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000002.8.10, , , , , ] 2021-07-26T15:46:36.637 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:41.635 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:41.627+0000 7f160a0d1b00 1 bucket sync caught up with source: 2021-07-26T15:46:41.635 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:41.635 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:41.635 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:41.627+0000 7f160a0d1b00 0 bucket checkpoint complete 2021-07-26T15:46:41.664 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:41.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:41.666 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:46:41.714 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:41.714 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:41.897 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:41.891+0000 7f90d57e1b00 1 waiting for incremental sync to catch up: 2021-07-26T15:46:41.897 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000003.10.9, , , , , ] 2021-07-26T15:46:41.897 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:46.901 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:46.891+0000 7f90d57e1b00 1 bucket sync caught up with source: 2021-07-26T15:46:46.902 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:46.902 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , 00000000003.10.9, , , 00000000031.75.8, , ] 2021-07-26T15:46:46.902 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:46:46.891+0000 7f90d57e1b00 0 bucket checkpoint complete 2021-07-26T15:46:46.930 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:46.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:46:46.932 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:46:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:46.987 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:46.982+0000 7f0701e22b00 -1 asok(0x55bd8eafe720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23557.asok': (13) Permission denied 2021-07-26T15:46:47.069 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:47.066+0000 7f0701e22b00 1 bucket sync caught up with source: 2021-07-26T15:46:47.070 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , 00000000002.16.10, , , 00000000032.91.5, , ] 2021-07-26T15:46:47.070 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , 00000000002.16.10, , , 00000000032.91.5, , ] 2021-07-26T15:46:47.071 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:47.066+0000 7f0701e22b00 0 bucket checkpoint complete 2021-07-26T15:46:47.099 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-13 zones={test-zone2, test-zone1} 2021-07-26T15:46:47.109 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:46:47.117 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:46:47.118 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.118 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.121 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.121 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.121 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.122 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.122 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.123 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.124 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.125 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.125 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.125 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.126 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.128 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:46:47.136 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:46:47.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.140 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.140 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:46:47.161 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:46:47.176 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:46:47.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:46:47.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.491 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:47.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.170 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.230 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.750 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.805 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:48.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.090 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.325 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.619 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.806 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:49.963 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.079 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.202 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.258 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.381 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:50.960 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.404 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:51.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.098 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.264 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.676 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.789 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.847 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:52.962 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:46:53.069 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-13 zones={test-zone2, test-zone1} 2021-07-26T15:46:53.069 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.070 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.071 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:53.112 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:53.113 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:53.117 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:53.114+0000 7f56f1393b00 -1 asok(0x56413a81d720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23635.asok': (13) Permission denied 2021-07-26T15:46:53.240 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:46:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.241 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000002640", 2021-07-26T15:46:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:46:34.020562Z" 2021-07-26T15:46:53.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000000905", 2021-07-26T15:46:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:58.799690Z" 2021-07-26T15:46:53.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000001439", 2021-07-26T15:46:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:45:50.015596Z" 2021-07-26T15:46:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:53.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000001169", 2021-07-26T15:46:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:46:34.024004Z" 2021-07-26T15:46:53.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:53.246 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:46:53.247 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:46:53.248 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.249 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:53.294 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:53.294 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:53.493 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:46:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:46:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:46:53.494 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:46:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:46:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: "instance_id": 5916101682454590024 2021-07-26T15:46:53.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:46:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:46:53.496 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000002640", 2021-07-26T15:46:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.497 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:34.020562Z" 2021-07-26T15:46:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:46:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000000905", 2021-07-26T15:46:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.500 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.799690Z" 2021-07-26T15:46:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.501 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:46:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000001439", 2021-07-26T15:46:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.502 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:45:50.015596Z" 2021-07-26T15:46:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:46:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.504 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.512 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000001169", 2021-07-26T15:46:53.512 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.512 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.513 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.513 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:34.024004Z" 2021-07-26T15:46:53.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.520 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:46:53.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.521 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:46:53.521 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:46:53.521 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:46:53.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.522 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:46:53.523 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:46:53.524 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.526 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:53.576 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:53.570+0000 7eff5f7e2b00 -1 asok(0x55c81064d720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23711.asok': (13) Permission denied 2021-07-26T15:46:53.699 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:46:53.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.700 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000002640", 2021-07-26T15:46:53.701 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:46:34.020562Z" 2021-07-26T15:46:53.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:53.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.701 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000000905", 2021-07-26T15:46:53.701 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:42:58.799690Z" 2021-07-26T15:46:53.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:53.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.702 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000001439", 2021-07-26T15:46:53.703 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:45:50.015596Z" 2021-07-26T15:46:53.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:53.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:53.704 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000001169", 2021-07-26T15:46:53.704 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:46:34.024004Z" 2021-07-26T15:46:53.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:53.705 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:46:53.707 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:46:53.709 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.710 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:53.756 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:53.756 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:53.949 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:46:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:46:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:46:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:46:53.950 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:46:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "instance_id": 3344727561966438302 2021-07-26T15:46:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:46:53.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:46:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.952 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000002640", 2021-07-26T15:46:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.953 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:34.020562Z" 2021-07-26T15:46:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:46:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000000905", 2021-07-26T15:46:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:42:58.799690Z" 2021-07-26T15:46:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.957 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:46:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.958 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000001439", 2021-07-26T15:46:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.959 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:45:50.015596Z" 2021-07-26T15:46:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:46:53.960 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "incremental-sync", 2021-07-26T15:46:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000001169", 2021-07-26T15:46:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:53.961 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:34.024004Z" 2021-07-26T15:46:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.962 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:46:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:46:53.963 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:46:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:46:53.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:53.964 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:46:53.965 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:46:53.966 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:53.967 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:54.010 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:54.011 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:54.227 INFO:teuthology.orchestra.run.smithi111.stdout:[ 2021-07-26T15:46:54.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.227 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000002374", 2021-07-26T15:46:54.228 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "2021-07-26T15:46:33.970864Z" 2021-07-26T15:46:54.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.228 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000000905", 2021-07-26T15:46:54.229 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "2021-07-26T15:43:17.292513Z" 2021-07-26T15:46:54.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.229 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000001439", 2021-07-26T15:46:54.230 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "2021-07-26T15:45:49.967110Z" 2021-07-26T15:46:54.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.230 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "00000000000000000000:00000000000000001169", 2021-07-26T15:46:54.231 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "2021-07-26T15:46:33.974423Z" 2021-07-26T15:46:54.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.231 INFO:teuthology.orchestra.run.smithi111.stdout:] 2021-07-26T15:46:54.235 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:46:54.235 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:54.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:54.236 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:54.285 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:54.282+0000 7f34b0695b00 -1 asok(0x56401a6fa720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23787.asok': (13) Permission denied 2021-07-26T15:46:54.395 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:46:54.396 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_status": { 2021-07-26T15:46:54.396 INFO:teuthology.orchestra.run.smithi018.stdout: "info": { 2021-07-26T15:46:54.397 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "sync", 2021-07-26T15:46:54.397 INFO:teuthology.orchestra.run.smithi018.stdout: "num_shards": 4, 2021-07-26T15:46:54.397 INFO:teuthology.orchestra.run.smithi018.stdout: "instance_id": 9107803290644410213 2021-07-26T15:46:54.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.398 INFO:teuthology.orchestra.run.smithi018.stdout: "markers": [ 2021-07-26T15:46:54.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.398 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 0, 2021-07-26T15:46:54.398 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:46:54.399 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "incremental-sync", 2021-07-26T15:46:54.399 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000002374", 2021-07-26T15:46:54.399 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:46:54.399 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:46:54.400 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:46:54.400 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "2021-07-26T15:46:33.970864Z" 2021-07-26T15:46:54.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.401 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 1, 2021-07-26T15:46:54.401 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:46:54.401 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "incremental-sync", 2021-07-26T15:46:54.402 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000000905", 2021-07-26T15:46:54.402 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:46:54.402 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:46:54.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:46:54.403 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "2021-07-26T15:43:17.292513Z" 2021-07-26T15:46:54.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.403 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 2, 2021-07-26T15:46:54.404 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:46:54.404 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "incremental-sync", 2021-07-26T15:46:54.404 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000001439", 2021-07-26T15:46:54.404 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:46:54.405 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:46:54.405 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:46:54.405 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "2021-07-26T15:45:49.967110Z" 2021-07-26T15:46:54.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.406 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 3, 2021-07-26T15:46:54.406 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:46:54.407 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "incremental-sync", 2021-07-26T15:46:54.407 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "00000000000000000000:00000000000000001169", 2021-07-26T15:46:54.407 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:46:54.407 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:46:54.407 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:46:54.408 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "2021-07-26T15:46:33.974423Z" 2021-07-26T15:46:54.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2021-07-26T15:46:54.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.409 INFO:teuthology.orchestra.run.smithi018.stdout: "full_sync": { 2021-07-26T15:46:54.409 INFO:teuthology.orchestra.run.smithi018.stdout: "total": 0, 2021-07-26T15:46:54.409 INFO:teuthology.orchestra.run.smithi018.stdout: "complete": 0 2021-07-26T15:46:54.410 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.410 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:46:54.411 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:46:54.412 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2021-07-26T15:46:54.439 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:54.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:54.441 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:54.486 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:54.486 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:54.490 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:46:54.486+0000 7f4d8af32b00 -1 asok(0x55b0ca27d720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23868.asok': (13) Permission denied 2021-07-26T15:46:54.571 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:46:54.599 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:46:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314414.435457_97.1", 2021-07-26T15:46:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:46:54.435457Z" 2021-07-26T15:46:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:46:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:46:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:46:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:46:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:46:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:46:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:46:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:46:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:46:54.605 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:46:54.606 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:46:54.607 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:54.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:54.608 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:54.650 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:54.650 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:54.859 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:46:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:46:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:46:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:46:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:46:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:46:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:46:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:46:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314347.889594_90.1", 2021-07-26T15:46:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:46:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:45:47.889594Z", 2021-07-26T15:46:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:46:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:46:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:46:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:46:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:46:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:46:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:46:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:46:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:46:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:46:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:46:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:46:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:46:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:46:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:46:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:46:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:46:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:46:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:46:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:46:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:46:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:46:54.873 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:46:54.875 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314414.435457_97.1 target=1_1627314347.889594_90.1 2021-07-26T15:46:59.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:59.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:46:59.877 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:46:59.918 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:59.918 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:00.120 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:00.120 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:00.120 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:00.121 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:00.121 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:00.121 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:00.121 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.122 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:00.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.122 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:00.122 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.123 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.123 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314414.435457_97.1", 2021-07-26T15:47:00.123 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.124 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:00.124 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.124 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:54.435457Z", 2021-07-26T15:47:00.125 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.126 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:00.126 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.126 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.127 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:00.127 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.127 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:00.127 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.127 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:00.128 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.129 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:00.129 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.129 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.130 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:00.130 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.130 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:00.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.130 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:00.131 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.132 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:00.132 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.132 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.135 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:00.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.136 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:00.136 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:00.136 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:00.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.137 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:00.139 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:47:00.140 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:47:00.140 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:00.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:00.142 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:00.220 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:00.220 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:00.412 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:00.413 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:00.413 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:00.413 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:00.413 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:00.414 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:00.414 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.414 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:00.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.415 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:00.415 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.415 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.416 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314347.889594_90.1", 2021-07-26T15:47:00.416 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.416 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:00.416 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.417 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:45:47.889594Z", 2021-07-26T15:47:00.417 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.417 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.418 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:00.419 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.419 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.419 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:00.419 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.420 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:00.420 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.420 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:00.420 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.421 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.421 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:00.422 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.422 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.422 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:00.422 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.422 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:00.423 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.423 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:00.423 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.423 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:00.424 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:00.424 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:00.425 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:00.425 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:00.425 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:00.425 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:00.425 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:00.426 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:00.426 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:00.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.427 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:00.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:00.427 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:00.427 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:00.428 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:00.428 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:00.428 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:00.430 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314414.435457_97.1 target=1_1627314347.889594_90.1 2021-07-26T15:47:05.431 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:05.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:05.433 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:05.475 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:05.476 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:05.662 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:05.663 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:05.663 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:05.663 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:05.663 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:05.664 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:05.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:05.665 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:05.665 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:05.665 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:05.665 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314414.435457_97.1", 2021-07-26T15:47:05.666 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:05.666 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:05.666 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:05.666 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:54.435457Z", 2021-07-26T15:47:05.667 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:05.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:05.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:05.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:05.668 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:05.668 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:05.668 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:05.668 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:05.669 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:05.669 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:05.669 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:05.669 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:05.669 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:05.670 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:05.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:05.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:05.670 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:05.671 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:05.671 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:05.671 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:05.672 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:05.672 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:05.672 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:05.673 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:05.674 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:05.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:05.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:05.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:05.675 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:05.675 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:05.675 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:05.675 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:05.676 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:05.676 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:05.676 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:05.676 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:05.677 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:05.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:05.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:05.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:05.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:05.678 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:05.678 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:05.678 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:05.678 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:05.679 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:05.680 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:47:05.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:05.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:05.732 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:47:05.780 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:05.971+0000 7f59eb36db00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:05.979 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:47:05.979 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:10.981 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:10.975+0000 7f59eb36db00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:10.981 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:47:10.982 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:15.986 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:15.975+0000 7f59eb36db00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:15.987 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:47:15.988 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:20.988 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:20.979+0000 7f59eb36db00 1 bucket sync caught up with source: 2021-07-26T15:47:20.988 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:20.989 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:20.989 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:20.979+0000 7f59eb36db00 0 bucket checkpoint complete 2021-07-26T15:47:21.020 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:21.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:21.025 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:47:21.095 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:21.095 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:21.289 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:21.275+0000 7f4391660b00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:21.289 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:47:21.289 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:26.285 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:26.278+0000 7f4391660b00 1 bucket sync caught up with source: 2021-07-26T15:47:26.286 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:26.286 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:26.286 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:26.278+0000 7f4391660b00 0 bucket checkpoint complete 2021-07-26T15:47:26.315 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:26.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:26.317 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:47:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:26.367 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:26.371 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:47:26.365+0000 7fb9fd714b00 -1 asok(0x558658a96720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.23946.asok': (13) Permission denied 2021-07-26T15:47:26.468 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:47:26.461+0000 7fb9fd714b00 1 bucket sync caught up with source: 2021-07-26T15:47:26.469 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000001.17.5, , ] 2021-07-26T15:47:26.469 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000001.17.5, , ] 2021-07-26T15:47:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:47:26.461+0000 7fb9fd714b00 0 bucket checkpoint complete 2021-07-26T15:47:26.498 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-14 zones={test-zone2, test-zone1} 2021-07-26T15:47:26.507 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:47:26.555 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:47:26.556 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:47:26.562 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:47:26.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:47:26.642 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:47:26.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:47:26.775 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-14 zones={test-zone2, test-zone1} 2021-07-26T15:47:26.788 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:26.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:26.789 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:47:26.841+0000 7fc443ec5b00 -1 asok(0x55a636764720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24024.asok': (13) Permission denied 2021-07-26T15:47:26.928 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:47:26.956 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:47:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:47:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:47:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:47:26.784101Z" 2021-07-26T15:47:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:47:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:47:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:47:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:47:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:47:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:47:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:47:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:47:26.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:47:26.960 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:47:26.960 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:47:26.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:47:26.961 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:47:26.962 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:47:26.963 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:26.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:26.964 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:27.004 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:27.005 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:27.212 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:27.213 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:27.213 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:27.213 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:27.214 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:27.214 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:27.214 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:27.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:27.215 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:27.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:27.215 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:27.215 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:27.215 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:27.216 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314414.435457_97.1", 2021-07-26T15:47:27.216 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:27.216 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:27.216 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:27.217 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:54.435457Z", 2021-07-26T15:47:27.217 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:27.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:27.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:27.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:27.218 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:27.218 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:27.218 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:27.219 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:27.219 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:27.220 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:27.220 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:27.220 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:27.220 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:27.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:27.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:27.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:27.222 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:27.222 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:27.222 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:27.224 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:27.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:27.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:27.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:27.226 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:27.226 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:27.226 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:27.226 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:27.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:27.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:27.227 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:27.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:27.228 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:27.228 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:27.228 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:27.228 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:27.228 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:27.230 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314446.784101_101.1 target=1_1627314414.435457_97.1 2021-07-26T15:47:32.234 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:32.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:32.236 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:32.279 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:32.280 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:32.474 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:32.474 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:32.477 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:32.477 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:32.478 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:32.478 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:32.478 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:32.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:32.479 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:32.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:32.480 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:32.480 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:32.480 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:32.480 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314414.435457_97.1", 2021-07-26T15:47:32.481 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:32.481 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:32.481 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:32.481 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:54.435457Z", 2021-07-26T15:47:32.481 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:32.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:32.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:32.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:32.482 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:32.483 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:32.483 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:32.483 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:32.483 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:32.483 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:32.484 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:32.484 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:32.484 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:32.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:32.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:32.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:32.485 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:32.485 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:32.485 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:32.486 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:32.486 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:32.486 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:32.486 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:32.487 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:32.487 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:32.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:32.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:32.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:32.488 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:32.488 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:32.488 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:32.488 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:32.489 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:32.489 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:32.489 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:32.489 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:32.489 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:32.490 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:32.490 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:32.490 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:32.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:32.491 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:32.491 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:32.491 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:32.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:32.497 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:32.498 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314446.784101_101.1 target=1_1627314414.435457_97.1 2021-07-26T15:47:37.500 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:37.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:37.503 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:37.547 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:37.547 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:37.739 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:37.739 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:37.740 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:37.740 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:37.740 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:37.741 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:37.741 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:37.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:37.741 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:37.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:37.742 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:37.742 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:37.742 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:37.742 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:47:37.743 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:37.743 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:37.743 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:37.743 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:47:26.784101Z", 2021-07-26T15:47:37.744 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:37.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:37.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:37.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:37.744 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:37.745 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:37.745 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:37.745 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:37.745 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:37.746 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:37.746 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:37.746 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:37.746 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:37.746 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:37.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:37.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:37.747 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:37.747 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:37.748 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:37.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:37.750 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:37.751 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:37.753 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:37.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:37.754 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:37.756 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:47:37.756 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:47:37.757 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:37.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:37.758 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:37.802 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:37.803 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:38.001 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:38.001 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:38.002 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:38.002 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:38.002 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:38.002 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:38.003 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:38.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:38.003 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:38.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:38.003 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:38.004 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:38.004 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:38.004 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314414.435457_97.1", 2021-07-26T15:47:38.004 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:38.005 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:38.007 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:38.007 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:46:54.435457Z", 2021-07-26T15:47:38.007 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:38.008 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:38.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:38.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:38.009 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:38.009 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:38.010 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:38.010 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:38.011 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:38.011 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:38.011 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:38.011 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:38.012 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:38.012 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:38.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:38.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:38.012 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:38.013 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:38.013 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:38.013 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:38.013 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:38.014 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:38.014 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:38.014 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:38.014 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:38.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:38.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:38.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:38.015 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:38.015 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:38.016 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:38.016 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:38.016 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:38.016 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:38.017 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:38.017 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:38.017 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:38.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:38.018 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:38.018 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:38.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:38.018 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:38.018 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:38.019 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:38.019 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:38.019 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:38.020 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314446.784101_101.1 target=1_1627314414.435457_97.1 2021-07-26T15:47:43.022 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:43.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:43.024 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:43.067 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:43.067 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:43.268 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:47:43.268 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:47:43.268 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:47:43.269 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:47:43.269 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:47:43.270 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:47:43.270 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:43.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:43.270 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:47:43.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:43.271 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:47:43.271 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:43.271 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:43.272 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:47:43.272 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:43.272 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:47:43.272 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:43.273 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:47:26.784101Z", 2021-07-26T15:47:43.273 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:43.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:43.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:43.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:43.274 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:47:43.274 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:43.275 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:43.275 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:47:43.275 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:43.276 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:43.276 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:43.276 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:47:43.276 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:43.277 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:43.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:43.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:43.277 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:47:43.278 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:43.278 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:43.278 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:43.278 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:43.279 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:43.279 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:43.279 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:43.279 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:43.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:43.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:43.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:47:43.280 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:47:43.281 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:47:43.281 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:47:43.281 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:47:43.281 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:47:43.282 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:47:43.282 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:47:43.282 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:47:43.282 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:47:43.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:43.283 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:43.283 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:47:43.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:47:43.284 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:47:43.284 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:47:43.284 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:47:43.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:47:43.284 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:47:43.286 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:47:43.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:43.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:43.338 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:47:43.390 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:43.391 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:43.581 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:43.574+0000 7fc6e0751b00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:43.581 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:43.582 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:47:48.584 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:48.574+0000 7fc6e0751b00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:48.584 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:48.584 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:47:53.588 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:53.578+0000 7fc6e0751b00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:53.588 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:53.588 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:47:58.589 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:58.582+0000 7fc6e0751b00 1 bucket sync caught up with source: 2021-07-26T15:47:58.589 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:47:58.589 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:47:58.589 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:58.582+0000 7fc6e0751b00 0 bucket checkpoint complete 2021-07-26T15:47:58.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:58.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:47:58.621 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:47:58.668 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:58.668 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:58.855 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:47:58.846+0000 7f7865e4fb00 1 waiting for incremental sync to catch up: 2021-07-26T15:47:58.856 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.11.5, , ] 2021-07-26T15:47:58.856 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:03.858 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:03.854+0000 7f7865e4fb00 1 bucket sync caught up with source: 2021-07-26T15:48:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:03.859 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:03.854+0000 7f7865e4fb00 0 bucket checkpoint complete 2021-07-26T15:48:03.889 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:48:03.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:48:03.890 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:48:03.943 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:03.943 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:03.947 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:48:03.940+0000 7fafae111b00 -1 asok(0x55f4bd74b720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24100.asok': (13) Permission denied 2021-07-26T15:48:04.043 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:48:04.036+0000 7fafae111b00 1 bucket sync caught up with source: 2021-07-26T15:48:04.044 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000003.22.12, , ] 2021-07-26T15:48:04.044 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000003.22.12, , ] 2021-07-26T15:48:04.044 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:48:04.036+0000 7fafae111b00 0 bucket checkpoint complete 2021-07-26T15:48:04.068 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-14 zones={test-zone2, test-zone1} 2021-07-26T15:48:04.079 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:48:04.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:48:04.128 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:48:04.129 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:48:04.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:48:04.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:48:04.189 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:48:04.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:48:04.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:48:04.350 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:48:04.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:48:04.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:48:04.497 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-14 zones={test-zone2, test-zone1} 2021-07-26T15:48:04.509 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:04.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:04.510 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:04.550 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:04.550 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:04.553 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:48:04.548+0000 7fbf759d7b00 -1 asok(0x55813f696720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24178.asok': (13) Permission denied 2021-07-26T15:48:04.634 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:48:04.662 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:48:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:48:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314484.505047_105.1", 2021-07-26T15:48:04.663 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:48:04.505047Z" 2021-07-26T15:48:04.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:48:04.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:48:04.663 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:04.664 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:48:04.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:48:04.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:48:04.664 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:48:04.664 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:48:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:48:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:48:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:48:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:48:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:48:04.666 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:48:04.667 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:48:04.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:04.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:04.669 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:04.712 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:04.712 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:04.918 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:48:04.918 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:48:04.918 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:48:04.918 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:48:04.919 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:48:04.919 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:48:04.919 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:04.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:04.920 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:48:04.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:04.920 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:48:04.920 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:04.921 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:04.921 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:48:04.921 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:04.921 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:48:04.921 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:04.922 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:47:26.784101Z", 2021-07-26T15:48:04.922 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:04.922 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:04.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:04.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:04.923 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:48:04.923 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:04.923 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:04.923 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:04.924 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:04.924 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:04.924 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:04.924 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:48:04.925 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:04.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:04.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:04.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:04.925 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:48:04.926 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:04.926 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:04.926 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:04.926 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:04.927 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:04.927 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:04.927 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:04.927 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:04.927 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:48:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:04.930 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:04.930 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:04.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:04.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:48:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:48:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:48:04.931 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:48:04.932 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:04.932 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:48:04.933 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314484.505047_105.1 target=1_1627314446.784101_101.1 2021-07-26T15:48:09.935 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:09.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:09.937 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:09.981 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:09.981 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:10.185 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:48:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:48:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:48:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:48:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:48:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:48:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:48:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:48:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:48:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:48:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:47:26.784101Z", 2021-07-26T15:48:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:48:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:48:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:48:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:48:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:48:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:48:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:48:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:48:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:10.200 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:48:10.201 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314484.505047_105.1 target=1_1627314446.784101_101.1 2021-07-26T15:48:15.202 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:15.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:15.204 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:15.247 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:15.248 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:15.442 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:48:15.443 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:48:15.443 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:48:15.443 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:48:15.444 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:48:15.444 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:48:15.444 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:15.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:15.445 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:48:15.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:15.446 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:48:15.446 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:15.446 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:15.447 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:48:15.447 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:15.447 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:48:15.448 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:15.448 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:47:26.784101Z", 2021-07-26T15:48:15.448 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:15.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:15.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:15.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:15.449 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:48:15.449 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:15.449 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:15.450 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:15.450 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:15.451 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:15.451 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:15.451 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:48:15.451 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:15.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:15.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:15.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:15.452 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:48:15.452 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:15.453 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:15.455 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:15.455 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:15.456 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:15.456 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:15.457 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:15.457 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:15.457 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:15.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:15.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:15.458 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:48:15.459 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:15.459 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:15.459 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:15.460 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:15.460 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:15.460 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:15.461 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:15.461 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:15.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:15.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:15.462 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:48:15.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:15.463 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:48:15.463 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:48:15.463 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:48:15.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:15.463 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:48:15.465 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314484.505047_105.1 target=1_1627314446.784101_101.1 2021-07-26T15:48:20.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:20.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:20.468 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:20.510 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:20.511 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:20.721 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:48:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:48:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:48:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:48:20.722 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:48:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:48:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:20.723 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:48:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:48:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:20.724 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314484.505047_105.1", 2021-07-26T15:48:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:48:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:48:04.505047Z", 2021-07-26T15:48:20.725 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:20.726 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:48:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:20.727 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:48:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:20.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:48:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:20.729 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:20.730 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:20.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:48:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:20.732 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:20.733 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:48:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:20.734 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:48:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:48:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:48:20.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:20.735 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:48:20.737 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:48:20.737 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:48:20.738 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:20.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:20.739 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:20.823 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:20.824 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:21.024 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:48:21.024 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:48:21.024 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:48:21.025 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:48:21.025 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:48:21.025 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:48:21.026 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:21.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:21.026 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:48:21.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:21.027 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:48:21.027 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:21.027 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:21.027 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314446.784101_101.1", 2021-07-26T15:48:21.028 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:21.028 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:48:21.028 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:21.028 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:47:26.784101Z", 2021-07-26T15:48:21.029 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:21.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:21.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:21.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:21.030 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:48:21.030 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:21.030 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:21.030 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:21.030 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:21.031 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:21.031 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:21.032 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:48:21.032 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:21.032 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:21.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:21.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:21.033 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:48:21.033 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:21.033 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:21.034 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:21.034 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:21.034 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:21.034 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:21.035 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:21.035 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:21.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:21.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:21.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:21.036 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:48:21.037 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:21.037 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:21.037 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:21.037 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:21.037 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:21.038 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:21.038 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:21.038 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:21.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:21.039 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:21.039 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:48:21.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:21.039 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:48:21.040 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:48:21.040 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:48:21.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:21.040 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:48:21.041 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314484.505047_105.1 target=1_1627314446.784101_101.1 2021-07-26T15:48:26.044 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:26.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:26.045 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:26.085 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:26.086 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:26.279 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:48:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:48:26.280 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:48:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:48:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:48:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:48:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:26.282 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:48:26.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:26.282 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:48:26.282 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:26.283 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:26.283 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314484.505047_105.1", 2021-07-26T15:48:26.283 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:26.283 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:48:26.284 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:26.284 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:48:04.505047Z", 2021-07-26T15:48:26.284 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:26.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:26.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:26.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:26.285 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:48:26.285 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:26.285 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:26.286 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:48:26.286 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:26.286 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:26.286 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:26.287 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:48:26.287 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:26.287 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:26.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:26.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:26.288 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:48:26.288 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:26.288 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:26.288 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:26.289 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:26.289 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:26.289 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:26.289 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:26.290 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:26.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:26.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:26.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:48:26.290 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:48:26.291 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:48:26.291 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:48:26.291 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:48:26.291 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:48:26.292 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:48:26.292 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:48:26.292 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:48:26.292 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:48:26.292 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:26.293 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:26.293 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:48:26.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:48:26.293 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:48:26.294 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:48:26.294 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:48:26.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:48:26.294 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:48:26.296 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:48:26.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:48:26.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:48:26.348 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:48:26.398 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:26.399 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:26.594 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:26.589+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:26.594 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:26.594 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:48:31.597 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:31.593+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:31.599 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:31.599 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:48:36.599 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:36.593+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:36.599 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:36.599 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:48:41.603 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:41.597+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:41.603 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:41.604 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:48:46.605 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:46.601+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:46.606 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:46.606 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:48:51.608 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:51.605+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:51.609 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:51.609 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:48:56.611 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:48:56.605+0000 7f8066a16b00 1 waiting for incremental sync to catch up: 2021-07-26T15:48:56.612 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:48:56.612 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:49:01.615 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:01.609+0000 7f8066a16b00 1 bucket sync caught up with source: 2021-07-26T15:49:01.615 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:49:01.616 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:49:01.616 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:01.609+0000 7f8066a16b00 0 bucket checkpoint complete 2021-07-26T15:49:01.640 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:01.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:01.642 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:01.688 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:01.689 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:01.864 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:01.861+0000 7ff39114db00 1 waiting for incremental sync to catch up: 2021-07-26T15:49:01.864 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.14.12, , ] 2021-07-26T15:49:01.865 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:49:06.867 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:06.861+0000 7ff39114db00 1 bucket sync caught up with source: 2021-07-26T15:49:06.867 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:49:06.868 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000005.18.17, , ] 2021-07-26T15:49:06.868 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:06.861+0000 7ff39114db00 0 bucket checkpoint complete 2021-07-26T15:49:06.899 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:06.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:06.904 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:06.955 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:06.956 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:06.960 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:06.951+0000 7f11cd97eb00 -1 asok(0x55a0e98f0720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24256.asok': (13) Permission denied 2021-07-26T15:49:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:07.051+0000 7f11cd97eb00 1 bucket sync caught up with source: 2021-07-26T15:49:07.060 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000005.28.17, , ] 2021-07-26T15:49:07.060 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000005.28.17, , ] 2021-07-26T15:49:07.060 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:07.051+0000 7f11cd97eb00 0 bucket checkpoint complete 2021-07-26T15:49:07.090 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-14 zones={test-zone2, test-zone1} 2021-07-26T15:49:07.103 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:49:07.152 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:07.153 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:07.154 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:49:07.162 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:07.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:07.217 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:07.229 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:07.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:07.356 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:07.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:07.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:07.514 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-14 zones={test-zone2, test-zone1} 2021-07-26T15:49:07.515 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2021-07-26T15:49:07.517 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-15 2021-07-26T15:49:07.545 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-16 2021-07-26T15:49:07.621 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:07.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:07.623 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:07.667 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:07.659+0000 7fd8db63bb00 -1 asok(0x55770b875720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24334.asok': (13) Permission denied 2021-07-26T15:49:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:49:07.772 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:49:07.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:07.773 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:49:07.774 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:49:07.612683Z" 2021-07-26T15:49:07.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:49:07.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:07.775 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:07.776 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:49:07.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:49:07.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:07.777 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:49:07.778 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:49:07.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:49:07.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:07.780 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:49:07.780 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:49:07.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:49:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:49:07.785 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:49:07.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:07.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:07.787 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:07.827 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:07.828 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:08.038 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:08.039 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:08.039 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:08.039 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:08.039 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:08.040 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:08.040 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:08.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:08.040 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:08.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:08.041 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:08.041 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:08.042 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:08.042 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314484.505047_105.1", 2021-07-26T15:49:08.042 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:08.043 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:08.043 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:08.044 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:48:04.505047Z", 2021-07-26T15:49:08.044 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:08.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:08.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:08.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:08.046 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:08.047 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:08.047 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:08.048 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:08.048 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:08.048 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:08.049 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:08.049 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:08.050 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:08.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:08.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:08.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:08.051 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:08.052 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:08.052 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:08.053 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:08.053 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:08.053 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:08.054 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:08.054 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:08.055 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:08.055 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:08.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:08.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:08.056 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:08.056 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:08.056 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:08.056 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:08.057 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:08.057 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:08.057 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:08.057 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:08.058 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:08.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:08.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:08.059 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:08.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:08.059 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:08.059 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:08.060 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:08.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:08.060 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:08.061 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314547.612683_120.1 target=1_1627314484.505047_105.1 2021-07-26T15:49:13.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:13.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:13.064 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:13.106 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:13.107 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:13.317 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:13.318 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:13.318 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:13.318 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:13.318 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:13.319 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:13.319 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:13.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:13.319 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:13.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:13.320 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:13.320 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:13.320 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:13.320 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314484.505047_105.1", 2021-07-26T15:49:13.321 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:13.321 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:13.321 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:13.321 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:48:04.505047Z", 2021-07-26T15:49:13.322 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:13.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:13.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:13.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:13.322 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:13.323 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:13.323 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:13.323 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:13.324 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:13.324 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:13.324 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:13.324 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:13.325 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:13.325 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:13.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:13.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:13.325 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:13.326 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:13.326 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:13.326 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:13.326 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:13.327 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:13.327 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:13.327 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:13.327 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:13.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:13.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:13.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:13.328 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:13.329 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:13.329 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:13.329 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:13.329 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:13.330 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:13.330 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:13.330 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:13.330 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:13.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:13.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:13.331 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:13.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:13.331 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:13.332 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:13.332 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:13.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:13.332 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:13.334 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314547.612683_120.1 target=1_1627314484.505047_105.1 2021-07-26T15:49:18.335 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:18.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:18.336 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:18.380 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:18.381 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:18.592 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:18.593 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:18.593 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:18.593 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:18.594 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:18.594 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:18.594 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.595 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:18.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.595 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:18.595 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.596 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.596 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:49:18.596 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.596 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:18.597 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.597 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:07.612683Z", 2021-07-26T15:49:18.597 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.599 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:18.599 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.599 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.599 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:18.600 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.600 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:18.600 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.601 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:18.601 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.601 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.602 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:18.602 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.602 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.602 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:18.603 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.603 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:18.603 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.603 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:18.604 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.604 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:18.605 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.605 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.606 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:18.606 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.606 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:18.607 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.607 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:18.607 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.608 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.608 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:18.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.608 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:18.608 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:18.609 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:18.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.609 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:18.610 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:49:18.611 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:49:18.611 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:18.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:18.613 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:18.692 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:18.693 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:18.880 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:18.881 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:18.881 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:18.881 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:18.881 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:18.882 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:18.882 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.882 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:18.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.883 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:18.883 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.883 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.884 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314484.505047_105.1", 2021-07-26T15:49:18.884 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.884 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:18.884 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.884 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:48:04.505047Z", 2021-07-26T15:49:18.885 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.885 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.886 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:18.886 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.886 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.886 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:18.888 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.888 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.890 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:18.890 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.890 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:18.890 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.891 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:18.891 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:18.891 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:18.892 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:18.892 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:18.892 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:18.892 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:18.893 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:18.893 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:18.893 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:18.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.894 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:18.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:18.894 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:18.894 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:18.895 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:18.895 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:18.895 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:18.896 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314547.612683_120.1 target=1_1627314484.505047_105.1 2021-07-26T15:49:23.898 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:23.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:23.899 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:23.941 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:23.941 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:24.133 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:24.133 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:24.133 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:24.134 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:24.134 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:24.134 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:24.134 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:24.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:24.135 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:24.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:24.136 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:24.136 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:24.136 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:24.136 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:49:24.136 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:24.137 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:24.137 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:24.137 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:07.612683Z", 2021-07-26T15:49:24.137 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:24.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:24.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:24.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:24.139 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:24.140 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:24.140 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:24.140 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:24.140 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:24.141 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:24.141 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:24.141 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:24.141 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:24.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:24.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:24.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:24.142 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:24.143 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:24.143 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:24.143 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:24.143 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:24.144 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:24.144 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:24.144 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:24.144 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:24.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:24.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:24.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:24.146 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:24.146 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:24.146 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:24.146 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:24.146 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:24.147 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:24.147 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:24.147 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:24.147 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:24.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:24.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:24.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:24.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:24.148 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:24.149 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:24.149 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:24.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:24.150 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:24.151 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:49:24.286 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:24.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:24.287 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:24.334 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:24.334 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:24.526 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:24.520+0000 7fea0beb5b00 1 waiting for incremental sync to catch up: 2021-07-26T15:49:24.526 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:49:24.526 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:29.529 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:29.524+0000 7fea0beb5b00 1 waiting for incremental sync to catch up: 2021-07-26T15:49:29.529 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:49:29.529 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:34.531 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:34.524+0000 7fea0beb5b00 1 waiting for incremental sync to catch up: 2021-07-26T15:49:34.532 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:49:34.532 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:39.534 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:39.528+0000 7fea0beb5b00 1 bucket sync caught up with source: 2021-07-26T15:49:39.535 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:39.535 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:39.535 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:39.528+0000 7fea0beb5b00 0 bucket checkpoint complete 2021-07-26T15:49:39.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:39.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:39.565 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:39.611 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:39.612 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:39.779 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:39.772+0000 7f20bb8d5b00 1 waiting for incremental sync to catch up: 2021-07-26T15:49:39.779 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:49:39.779 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:44.781 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:44.776+0000 7f20bb8d5b00 1 bucket sync caught up with source: 2021-07-26T15:49:44.782 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:44.782 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.6.11, , ] 2021-07-26T15:49:44.783 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:44.776+0000 7f20bb8d5b00 0 bucket checkpoint complete 2021-07-26T15:49:44.812 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:44.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:44.814 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-15 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:44.864 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:44.865 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:44.869 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:44.867+0000 7f3eef739b00 -1 asok(0x557bd67b3720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24413.asok': (13) Permission denied 2021-07-26T15:49:44.968 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:44.963+0000 7f3eef739b00 1 bucket sync caught up with source: 2021-07-26T15:49:44.968 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000002.6.5, , ] 2021-07-26T15:49:44.968 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000002.6.5, , ] 2021-07-26T15:49:44.969 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:44.963+0000 7f3eef739b00 0 bucket checkpoint complete 2021-07-26T15:49:44.997 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-15 zones={test-zone2, test-zone1} 2021-07-26T15:49:45.007 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:49:45.055 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.056 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.056 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:49:45.063 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.064 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:45.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:45.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:45.208 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-15 zones={test-zone2, test-zone1} 2021-07-26T15:49:45.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:45.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:45.210 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:45.260 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:45.260 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:45.443 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:45.436+0000 7fe66af88b00 1 bucket sync caught up with source: 2021-07-26T15:49:45.444 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000002.7.5, , ] 2021-07-26T15:49:45.444 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000002.7.5, , ] 2021-07-26T15:49:45.444 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:45.436+0000 7fe66af88b00 0 bucket checkpoint complete 2021-07-26T15:49:45.479 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:45.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:45.480 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:45.527 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:45.528 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:45.709 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:45.704+0000 7ff911a61b00 1 bucket sync caught up with source: 2021-07-26T15:49:45.709 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000002.7.5, , ] 2021-07-26T15:49:45.710 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000002.7.5, , ] 2021-07-26T15:49:45.710 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:49:45.704+0000 7ff911a61b00 0 bucket checkpoint complete 2021-07-26T15:49:45.740 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:45.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:49:45.741 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:49:45.790 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:45.791 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:45.796 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:45.791+0000 7fcd75d7db00 -1 asok(0x562059e27720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24491.asok': (13) Permission denied 2021-07-26T15:49:45.889 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:45.883+0000 7fcd75d7db00 1 bucket sync caught up with source: 2021-07-26T15:49:45.889 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000003.14.11, , ] 2021-07-26T15:49:45.889 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000003.14.11, , ] 2021-07-26T15:49:45.890 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:45.883+0000 7fcd75d7db00 0 bucket checkpoint complete 2021-07-26T15:49:45.917 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-16 zones={test-zone2, test-zone1} 2021-07-26T15:49:45.925 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:49:45.971 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.972 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.972 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:49:45.978 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:45.978 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:49:46.032 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:46.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:46.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:49:46.116 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-16 zones={test-zone2, test-zone1} 2021-07-26T15:49:46.117 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2021-07-26T15:49:46.118 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-17 2021-07-26T15:49:46.146 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-18 2021-07-26T15:49:46.254 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:46.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:46.255 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:46.296 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:46.296 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:49:46.295+0000 7f4875677b00 -1 asok(0x558ed7a45720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24569.asok': (13) Permission denied 2021-07-26T15:49:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:49:46.413 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:49:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314586.243256_153.1", 2021-07-26T15:49:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:49:46.243256Z" 2021-07-26T15:49:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:49:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:49:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:49:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:49:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:49:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:49:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:49:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:49:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:49:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:49:46.418 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:49:46.419 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:49:46.419 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:46.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:46.421 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:46.650 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:46.650 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:46.650 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:46.651 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:46.651 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:46.651 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:46.652 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:46.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:46.652 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:46.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:46.653 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:46.653 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:46.653 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:46.653 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:49:46.653 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:46.654 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:46.654 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:46.654 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:07.612683Z", 2021-07-26T15:49:46.654 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:46.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:46.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:46.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:46.655 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:46.656 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:46.656 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:46.656 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:46.656 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:46.656 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:46.657 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:46.657 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:46.657 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:46.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:46.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:46.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:46.658 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:46.658 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:46.658 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:46.659 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:46.659 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:46.659 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:46.659 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:46.659 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:46.660 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:46.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:46.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:46.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:46.660 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:46.661 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:46.661 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:46.661 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:46.661 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:46.662 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:46.662 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:46.662 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:46.662 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:46.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:46.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:46.664 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:46.666 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314586.243256_153.1 target=1_1627314547.612683_120.1 2021-07-26T15:49:51.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:51.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:51.669 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:51.707 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:51.708 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:51.919 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:51.919 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:51.920 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:51.921 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:51.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:51.921 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:51.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:51.923 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:51.923 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:51.923 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:49:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:07.612683Z", 2021-07-26T15:49:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:51.928 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:51.928 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:51.928 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:51.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:51.929 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:51.930 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:51.930 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:51.930 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:51.930 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:51.931 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:51.932 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:51.933 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:51.934 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:51.934 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:51.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:51.934 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:51.935 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:51.935 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:51.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:51.935 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:51.937 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314586.243256_153.1 target=1_1627314547.612683_120.1 2021-07-26T15:49:56.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:56.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:56.939 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:56.981 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:56.981 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:57.185 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:49:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:49:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:49:57.186 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:49:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:49:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:49:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:57.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:49:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:49:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:57.188 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:49:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:49:57.189 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:07.612683Z", 2021-07-26T15:49:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:57.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:49:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:57.191 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:49:57.192 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:57.192 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:57.192 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:57.192 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:49:57.193 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:57.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:57.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:57.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:57.193 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:49:57.194 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:57.194 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:57.194 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:57.194 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:57.195 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:57.195 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:57.195 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:57.195 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:57.195 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:57.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:57.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:49:57.196 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:49:57.196 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:49:57.196 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:49:57.197 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:49:57.197 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:49:57.197 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:49:57.197 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:49:57.198 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:49:57.198 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:49:57.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:57.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:57.198 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:49:57.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:49:57.199 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:49:57.199 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:49:57.199 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:49:57.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:49:57.200 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:49:57.201 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314586.243256_153.1 target=1_1627314547.612683_120.1 2021-07-26T15:50:02.203 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:02.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:02.204 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:02.246 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:02.246 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:02.453 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:02.453 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:02.453 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:02.454 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:02.454 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:02.454 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:02.454 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.455 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:02.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.455 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:02.456 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.456 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.456 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314586.243256_153.1", 2021-07-26T15:50:02.457 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.457 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:02.457 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.457 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:46.243256Z", 2021-07-26T15:50:02.458 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.459 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:02.459 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.459 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.459 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:02.459 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.460 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:02.460 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.460 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:02.461 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.462 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:02.462 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.462 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.463 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:02.463 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.463 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:02.463 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.464 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:02.464 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.464 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.465 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:02.465 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.465 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.465 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:02.465 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.466 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:02.466 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.466 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:02.467 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:02.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.468 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:02.468 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:02.468 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:02.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.469 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:02.470 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:02.471 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:02.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:02.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:02.472 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:02.553 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:02.553 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:02.759 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:02.760 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:02.760 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:02.760 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:02.761 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:02.761 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:02.761 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.762 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:02.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.762 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:02.763 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.763 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.763 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314547.612683_120.1", 2021-07-26T15:50:02.763 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.764 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:02.764 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.764 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:07.612683Z", 2021-07-26T15:50:02.764 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.766 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:02.767 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.767 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.768 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:02.769 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.769 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:02.769 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.770 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:02.770 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.772 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:02.772 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.773 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.773 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:02.774 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.774 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:02.775 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.775 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:02.775 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.776 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:02.777 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:02.777 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:02.778 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:02.778 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:02.779 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:02.779 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:02.779 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:02.780 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:02.781 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:02.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.782 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:02.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:02.783 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:02.783 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:02.783 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:02.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:02.784 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:02.785 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314586.243256_153.1 target=1_1627314547.612683_120.1 2021-07-26T15:50:07.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.788 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:07.830 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:07.831 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:08.013 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:08.013 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:08.014 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:08.014 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:08.014 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:08.014 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:08.015 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:08.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:08.015 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:08.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:08.017 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:08.017 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:08.018 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:08.018 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314586.243256_153.1", 2021-07-26T15:50:08.019 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:08.019 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:08.019 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:08.019 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:46.243256Z", 2021-07-26T15:50:08.020 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:08.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:08.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:08.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:08.020 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:08.021 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:08.021 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:08.021 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:08.022 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:08.022 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:08.023 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:08.023 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:08.023 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:08.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:08.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:08.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:08.024 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:08.024 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:08.024 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:08.025 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:08.025 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:08.025 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:08.025 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:08.025 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:08.026 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:08.027 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:08.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:08.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:08.028 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:08.028 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:08.029 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:08.029 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:08.029 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:08.030 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:08.030 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:08.030 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:08.030 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:08.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:08.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:08.031 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:08.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:08.032 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:08.032 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:08.032 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:08.032 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:08.033 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:08.034 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:08.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:08.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:08.185 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:50:08.229 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:08.230 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:08.415 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:08.407+0000 7ff68e464b00 1 waiting for incremental sync to catch up: 2021-07-26T15:50:08.416 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:50:08.416 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:13.417 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:13.411+0000 7ff68e464b00 1 waiting for incremental sync to catch up: 2021-07-26T15:50:13.418 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:50:13.418 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:18.420 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:18.415+0000 7ff68e464b00 1 bucket sync caught up with source: 2021-07-26T15:50:18.421 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:18.421 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:18.415+0000 7ff68e464b00 0 bucket checkpoint complete 2021-07-26T15:50:18.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:18.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:18.454 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:50:18.503 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:18.503 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:18.676 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:18.671+0000 7f73a8f79b00 1 waiting for incremental sync to catch up: 2021-07-26T15:50:18.676 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , , , ] 2021-07-26T15:50:18.677 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:23.678 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:23.671+0000 7f73a8f79b00 1 bucket sync caught up with source: 2021-07-26T15:50:23.678 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:23.678 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000003.11.6, , ] 2021-07-26T15:50:23.679 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:23.671+0000 7f73a8f79b00 0 bucket checkpoint complete 2021-07-26T15:50:23.704 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:23.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:23.705 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:50:23.757 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:23.758 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:23.761 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:23.758+0000 7f54f6ac8b00 -1 asok(0x5604d6926720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24645.asok': (13) Permission denied 2021-07-26T15:50:23.858 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:23.854+0000 7f54f6ac8b00 1 bucket sync caught up with source: 2021-07-26T15:50:23.859 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000001.13.12, , ] 2021-07-26T15:50:23.859 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000001.13.12, , ] 2021-07-26T15:50:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:23.854+0000 7f54f6ac8b00 0 bucket checkpoint complete 2021-07-26T15:50:23.888 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-17 zones={test-zone2, test-zone1} 2021-07-26T15:50:23.898 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:23.949 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:23.949 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:23.956 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:24.010 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:24.016 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-17 zones={test-zone2, test-zone1} 2021-07-26T15:50:24.017 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:24.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:24.018 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:50:24.066 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:24.067 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.263 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:24.255+0000 7f18cc9cbb00 1 bucket sync caught up with source: 2021-07-26T15:50:24.263 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.22.12, , ] 2021-07-26T15:50:24.264 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.22.12, , ] 2021-07-26T15:50:24.264 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:24.255+0000 7f18cc9cbb00 0 bucket checkpoint complete 2021-07-26T15:50:24.294 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:24.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:24.297 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket tnoxkv-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2021-07-26T15:50:24.344 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:24.344 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.521 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:24.515+0000 7f1bd05fcb00 1 bucket sync caught up with source: 2021-07-26T15:50:24.521 INFO:teuthology.orchestra.run.smithi111.stderr: local status: [, , , , , , , , 00000000001.22.12, , ] 2021-07-26T15:50:24.521 INFO:teuthology.orchestra.run.smithi111.stderr: remote markers: [, , , , , , , , 00000000001.22.12, , ] 2021-07-26T15:50:24.522 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:50:24.515+0000 7f1bd05fcb00 0 bucket checkpoint complete 2021-07-26T15:50:24.553 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:24.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'tnoxkv-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2021-07-26T15:50:24.554 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket tnoxkv-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2021-07-26T15:50:24.605 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:24.605 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.609 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:24.606+0000 7f6914b8fb00 -1 asok(0x55d3a4399720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24723.asok': (13) Permission denied 2021-07-26T15:50:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:24.706+0000 7f6914b8fb00 1 bucket sync caught up with source: 2021-07-26T15:50:24.712 INFO:teuthology.orchestra.run.smithi018.stderr: local status: [, , , , , , , , 00000000003.48.6, , ] 2021-07-26T15:50:24.713 INFO:teuthology.orchestra.run.smithi018.stderr: remote markers: [, , , , , , , , 00000000003.48.6, , ] 2021-07-26T15:50:24.713 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:24.706+0000 7f6914b8fb00 0 bucket checkpoint complete 2021-07-26T15:50:24.742 INFO:tasks.rgw_multi.zone_rados:comparing bucket=tnoxkv-18 zones={test-zone2, test-zone1} 2021-07-26T15:50:24.750 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:24.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:24.800 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:24.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:24.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:24.873 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=tnoxkv-18 zones={test-zone2, test-zone1} 2021-07-26T15:50:24.874 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2021-07-26T15:50:24.875 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-19 2021-07-26T15:50:24.906 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-20 2021-07-26T15:50:25.079 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2021-07-26T15:50:25.080 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-21 2021-07-26T15:50:25.109 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-22 2021-07-26T15:50:25.284 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2021-07-26T15:50:25.284 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-23 2021-07-26T15:50:25.311 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-24 2021-07-26T15:50:26.483 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2021-07-26T15:50:26.484 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-25 2021-07-26T15:50:26.511 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-26 2021-07-26T15:50:26.556 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.558 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:26.604 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:26.598+0000 7f51c8f2bb00 -1 asok(0x564f402f3720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24801.asok': (13) Permission denied 2021-07-26T15:50:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:50:26.711 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:50:26.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:26.712 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:26.712 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:50:26.535085Z" 2021-07-26T15:50:26.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:50:26.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:26.713 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:26.713 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:50:26.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:50:26.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:26.713 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:50:26.714 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:50:26.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:50:26.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:26.714 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:50:26.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:50:26.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:50:26.715 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:50:26.716 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:26.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.718 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:26.758 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:26.759 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:26.952 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:26.952 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:26.952 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:26.953 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:26.953 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:26.953 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:26.953 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:26.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:26.954 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:26.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:26.954 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:26.955 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:26.955 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:26.955 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314586.243256_153.1", 2021-07-26T15:50:26.955 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:26.956 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:26.956 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:26.956 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:46.243256Z", 2021-07-26T15:50:26.956 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:26.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:26.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:26.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:26.957 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:26.958 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:26.958 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:26.958 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:26.958 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:26.959 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:26.959 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:26.960 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:26.960 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:26.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:26.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:26.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:26.961 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:26.961 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:26.961 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:26.962 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:26.962 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:26.962 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:26.962 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:26.963 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:26.963 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:26.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:26.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:26.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:26.964 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:26.964 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:26.964 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:26.965 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:26.965 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:26.965 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:26.966 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:26.966 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:26.966 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:26.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:26.967 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:26.967 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:26.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:26.967 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:26.967 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:26.968 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:26.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:26.968 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:26.970 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314626.535085_202.1 target=1_1627314586.243256_153.1 2021-07-26T15:50:31.971 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.972 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:32.014 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:32.014 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:32.211 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:32.211 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:32.211 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:32.212 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:32.212 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:32.212 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:32.213 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:32.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:32.213 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:32.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:32.213 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:32.214 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:32.214 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:32.214 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314586.243256_153.1", 2021-07-26T15:50:32.215 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:32.215 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:32.215 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:32.215 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:49:46.243256Z", 2021-07-26T15:50:32.216 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:32.216 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:32.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:32.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:32.217 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:32.217 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:32.217 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:32.218 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:32.218 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:32.218 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:32.218 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:32.219 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:32.219 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:32.219 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:32.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:32.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:32.220 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:32.220 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:32.220 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:32.221 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:32.221 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:32.221 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:32.221 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:32.221 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:32.222 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:32.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:32.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:32.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:32.223 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:32.223 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:32.223 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:32.223 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:32.224 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:32.224 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:32.224 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:32.224 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:32.224 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:32.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:32.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:32.225 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:32.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:32.226 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:32.226 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:32.226 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:32.226 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:32.227 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:32.228 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314626.535085_202.1 target=1_1627314586.243256_153.1 2021-07-26T15:50:37.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:37.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:37.231 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:37.505 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:37.506 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:37.506 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:37.506 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:37.506 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:37.507 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:37.507 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:37.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:37.507 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:37.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:37.508 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:37.508 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:37.508 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:37.508 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.501702_197.1", 2021-07-26T15:50:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.501702Z", 2021-07-26T15:50:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:37.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:37.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:37.510 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:37.510 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:37.511 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:37.511 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:37.511 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:37.511 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:37.511 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:37.512 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:37.512 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:37.512 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:37.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:37.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:37.512 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:37.513 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:37.513 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:37.513 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:37.513 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:37.513 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:37.514 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:37.514 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:37.514 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:37.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:37.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:37.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:37.515 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:37.515 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:37.515 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:37.516 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:37.516 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:37.516 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:37.516 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:37.516 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:37.517 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:37.517 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:37.517 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:37.517 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:37.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:37.518 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:37.518 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:37.518 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:37.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:37.518 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:37.520 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314626.535085_202.1 target=1_1627314626.501702_197.1 2021-07-26T15:50:42.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.523 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:42.563 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:42.564 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:42.811 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:42.812 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:42.812 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:42.812 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:42.812 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:42.813 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:42.813 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:42.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:42.813 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:42.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:42.814 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:42.814 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:42.814 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:42.814 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:42.815 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:42.815 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:42.815 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:42.815 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.535085Z", 2021-07-26T15:50:42.816 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:42.816 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:42.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:42.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:42.817 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:42.817 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:42.817 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:42.818 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:42.818 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:42.818 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:42.818 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:42.819 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:42.819 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:42.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:42.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:42.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:42.820 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:42.820 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:42.820 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:42.820 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:42.821 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:42.821 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:42.821 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:42.821 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:42.821 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:42.822 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:42.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:42.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:42.822 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:42.823 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:42.823 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:42.823 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:42.823 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:42.823 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:42.824 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:42.824 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:42.824 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:42.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:42.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:42.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:42.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:42.825 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:42.825 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:42.826 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:42.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:42.826 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:42.827 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:42.828 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:42.828 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.829 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:42.867 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:42.868 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.063 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:43.063 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:43.064 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:43.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.066 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.535085Z", 2021-07-26T15:50:43.067 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.068 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:43.069 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:43.071 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:43.072 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.074 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:43.075 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:43.077 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:43.078 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.078 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:43.079 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:43.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-07-26T15:50:43.305 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-27 2021-07-26T15:50:43.329 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-28 2021-07-26T15:50:43.375 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.379 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.421 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.421 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:50:43.422+0000 7f7bc6297b00 -1 asok(0x55d877d35720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.24878.asok': (13) Permission denied 2021-07-26T15:50:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=148a74da-a164-4b33-8c58-4bf793871dd4 2021-07-26T15:50:43.534 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:50:43.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314643.353553_212.1", 2021-07-26T15:50:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:50:43.353553Z" 2021-07-26T15:50:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:50:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:43:23.666519Z" 2021-07-26T15:50:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:50:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:43.536 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:50:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:50:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:50:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:50:43.537 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:50:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:50:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:50:43.538 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:50:43.540 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:43.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.542 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.582 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.583 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.782 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:43.782 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:43.782 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:43.783 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:43.783 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:43.783 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:43.783 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.784 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:43.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.784 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:43.785 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.785 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.785 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:43.785 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.786 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:43.786 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.786 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.535085Z", 2021-07-26T15:50:43.786 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.787 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:43.787 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.788 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.788 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:43.788 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.788 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:43.789 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.789 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:43.789 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.790 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:43.790 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.790 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.791 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:43.791 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.791 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:43.791 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.791 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:43.792 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.792 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:43.793 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:43.793 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:43.793 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:43.793 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:43.793 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:43.794 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:43.794 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:43.794 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:43.794 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:43.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:43.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:43.795 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:43.796 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:43.796 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:43.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:43.796 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:43.797 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314643.353553_212.1 target=1_1627314626.535085_202.1 2021-07-26T15:50:48.799 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.801 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.845 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.846 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.055 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:49.055 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:49.056 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:49.056 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:49.056 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:49.056 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:49.056 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:49.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:49.057 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:49.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:49.057 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:49.058 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:49.058 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:49.058 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:49.059 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:49.059 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:49.059 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:49.059 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.535085Z", 2021-07-26T15:50:49.059 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:49.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:49.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:49.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:49.060 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:49.061 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:49.061 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:49.061 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:49.061 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:49.061 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:49.062 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:49.062 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:49.062 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:49.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:49.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:49.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:49.063 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:49.063 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:49.063 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:49.064 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:49.064 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:49.064 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:49.064 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:49.065 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:49.065 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:49.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:49.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:49.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:49.066 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:49.066 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:49.066 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:49.066 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:49.067 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:49.067 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:49.067 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:49.067 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:49.067 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:49.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:49.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:49.071 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:49.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:49.071 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:49.071 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:49.071 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:49.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:49.072 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:49.073 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314643.353553_212.1 target=1_1627314626.535085_202.1 2021-07-26T15:50:54.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.076 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:54.118 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:54.119 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:54.329 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:54.330 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:54.330 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:54.330 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:54.330 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:54.331 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:54.331 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:54.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:54.331 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:54.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:54.332 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:54.332 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:54.332 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:54.332 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:54.333 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.535085Z", 2021-07-26T15:50:54.334 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:54.335 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:54.336 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:54.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:54.338 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:54.339 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:54.340 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:54.342 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:54.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:54.344 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:54.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:54.345 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:54.346 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314643.353553_212.1 target=1_1627314626.535085_202.1 2021-07-26T15:50:59.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:59.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:59.349 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:59.596 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:59.596 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:59.596 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:59.596 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:59.597 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:59.597 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:59.597 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.598 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:59.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.598 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:59.598 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.599 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.599 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314643.353553_212.1", 2021-07-26T15:50:59.599 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.599 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:59.600 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.600 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:43.353553Z", 2021-07-26T15:50:59.600 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.600 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.601 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:59.601 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.601 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.602 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:59.602 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.602 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:59.603 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.603 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:59.603 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.604 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:59.604 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.604 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.605 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:59.605 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.605 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:59.606 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.606 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:59.606 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.607 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:59.607 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.608 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.608 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:59.608 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.608 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:59.609 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.609 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:59.609 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.609 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.610 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:59.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.610 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:59.610 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:59.611 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:59.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.611 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:59.612 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:59.613 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:59.614 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:59.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:59.615 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:59.699 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:59.700 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:59.899 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:50:59.900 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:50:59.900 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:50:59.900 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:50:59.901 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:50:59.901 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:50:59.901 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.902 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:50:59.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.902 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:50:59.902 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.902 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.903 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314626.535085_202.1", 2021-07-26T15:50:59.903 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.903 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:50:59.903 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.904 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:26.535085Z", 2021-07-26T15:50:59.904 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.904 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.905 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:50:59.905 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.905 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.905 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:50:59.906 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.906 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:59.906 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.907 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:50:59.907 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.908 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:50:59.908 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.909 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.909 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:59.909 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.909 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:59.909 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.910 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:59.910 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.910 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:50:59.911 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:50:59.911 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:50:59.911 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:50:59.912 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:50:59.912 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:50:59.912 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:50:59.912 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:50:59.913 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:50:59.913 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:50:59.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.914 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.914 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:50:59.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:50:59.914 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:50:59.914 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:50:59.915 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:50:59.915 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:50:59.915 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:50:59.916 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=0 master=1_1627314643.353553_212.1 target=1_1627314626.535085_202.1 2021-07-26T15:51:04.918 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:04.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:04.919 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:04.962 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:04.962 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:05.174 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:51:05.174 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:51:05.174 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:51:05.175 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "sync", 2021-07-26T15:51:05.175 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 4, 2021-07-26T15:51:05.175 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:51:05.175 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:51:05.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:05.176 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [ 2021-07-26T15:51:05.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:05.176 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 0, 2021-07-26T15:51:05.176 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:51:05.177 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:51:05.177 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314643.353553_212.1", 2021-07-26T15:51:05.177 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:51:05.177 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 1, 2021-07-26T15:51:05.178 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:51:05.178 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:50:43.353553Z", 2021-07-26T15:51:05.178 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:51:05.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:05.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:05.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:05.179 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 1, 2021-07-26T15:51:05.179 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:51:05.179 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:51:05.180 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314203.666519_93.1", 2021-07-26T15:51:05.180 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:51:05.180 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:51:05.180 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:51:05.181 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "2021-07-26T15:43:23.666519Z", 2021-07-26T15:51:05.181 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:51:05.181 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:05.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:05.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:05.182 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 2, 2021-07-26T15:51:05.182 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:51:05.182 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:51:05.182 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:51:05.183 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:51:05.183 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:51:05.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:51:05.183 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:51:05.183 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:51:05.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:05.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:05.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:05.184 INFO:teuthology.orchestra.run.smithi111.stdout: "key": 3, 2021-07-26T15:51:05.185 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:51:05.185 INFO:teuthology.orchestra.run.smithi111.stdout: "state": 1, 2021-07-26T15:51:05.185 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:51:05.185 INFO:teuthology.orchestra.run.smithi111.stdout: "next_step_marker": "", 2021-07-26T15:51:05.185 INFO:teuthology.orchestra.run.smithi111.stdout: "total_entries": 0, 2021-07-26T15:51:05.186 INFO:teuthology.orchestra.run.smithi111.stdout: "pos": 0, 2021-07-26T15:51:05.186 INFO:teuthology.orchestra.run.smithi111.stdout: "timestamp": "0.000000", 2021-07-26T15:51:05.186 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 2 2021-07-26T15:51:05.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:05.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:05.187 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:51:05.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:05.187 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:51:05.188 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 1, 2021-07-26T15:51:05.188 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 1 2021-07-26T15:51:05.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:05.188 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:51:05.189 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:51:05.190 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-07-26T15:51:05.191 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:51:05.192 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:51:05.182+0000 7f75deffd700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 21502) UID: 0 2021-07-26T15:51:05.192 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:51:05.182+0000 7f75ef8b8b40 -1 shutting down 2021-07-26T15:51:05.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-07-26T15:51:11.292 INFO:tasks.rgw.c2.client.1:Stopped 2021-07-26T15:51:11.293 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:11.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:11.295 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:11.337 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:11.337 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:11.365 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:51:11.358+0000 7ffb36775b00 0 NOTICE: overriding master zone: 112afa81-a585-483c-a26d-c230749bfd0c 2021-07-26T15:51:11.365 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:51:11.358+0000 7ffb36775b00 0 failed reading obj info from .rgw.root:zone_info.112afa81-a585-483c-a26d-c230749bfd0c: (2) No such file or directory 2021-07-26T15:51:11.366 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T15:51:11.358+0000 7ffb36775b00 0 WARNING: could not read zone params for zone id=112afa81-a585-483c-a26d-c230749bfd0c name=test-zone1 2021-07-26T15:51:11.377 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:51:11.377 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:51:11.378 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T15:51:11.378 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "test-zone2.rgw.meta:root", 2021-07-26T15:51:11.378 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "test-zone2.rgw.control", 2021-07-26T15:51:11.379 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2021-07-26T15:51:11.379 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2021-07-26T15:51:11.380 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "test-zone2.rgw.log", 2021-07-26T15:51:11.380 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2021-07-26T15:51:11.380 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2021-07-26T15:51:11.380 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2021-07-26T15:51:11.380 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2021-07-26T15:51:11.381 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2021-07-26T15:51:11.381 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2021-07-26T15:51:11.381 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2021-07-26T15:51:11.381 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2021-07-26T15:51:11.382 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "test-zone2.rgw.otp", 2021-07-26T15:51:11.382 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T15:51:11.382 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:51:11.382 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:51:11.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.383 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T15:51:11.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.383 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T15:51:11.383 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T15:51:11.384 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2021-07-26T15:51:11.384 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T15:51:11.384 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T15:51:11.384 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "test-zone2.rgw.buckets.data", 2021-07-26T15:51:11.384 INFO:teuthology.orchestra.run.smithi111.stdout: "compression_type": "random" 2021-07-26T15:51:11.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.385 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2021-07-26T15:51:11.385 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T15:51:11.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.386 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.386 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:51:11.386 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2021-07-26T15:51:11.387 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:51:11.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:11.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:11.389 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:11.427 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:11.428 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:11.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-07-26T15:51:11.638 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:51:11.638 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "300cac0e-0a1a-420f-8b26-7b3aa1858a04", 2021-07-26T15:51:11.639 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 1, 2021-07-26T15:51:11.639 INFO:teuthology.orchestra.run.smithi111.stdout: "predecessor_uuid": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T15:51:11.639 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": [ 2021-07-26T15:51:11.640 INFO:teuthology.orchestra.run.smithi111.stdout: "1_1627314643.353553_212.1", 2021-07-26T15:51:11.640 INFO:teuthology.orchestra.run.smithi111.stdout: "1_1627314203.666519_93.1", 2021-07-26T15:51:11.640 INFO:teuthology.orchestra.run.smithi111.stdout: "", 2021-07-26T15:51:11.640 INFO:teuthology.orchestra.run.smithi111.stdout: "" 2021-07-26T15:51:11.641 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.641 INFO:teuthology.orchestra.run.smithi111.stdout: "period_map": { 2021-07-26T15:51:11.642 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "300cac0e-0a1a-420f-8b26-7b3aa1858a04", 2021-07-26T15:51:11.642 INFO:teuthology.orchestra.run.smithi111.stdout: "zonegroups": [ 2021-07-26T15:51:11.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.643 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "test-zonegroup", 2021-07-26T15:51:11.644 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zonegroup", 2021-07-26T15:51:11.644 INFO:teuthology.orchestra.run.smithi111.stdout: "api_name": "", 2021-07-26T15:51:11.644 INFO:teuthology.orchestra.run.smithi111.stdout: "is_master": "true", 2021-07-26T15:51:11.644 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:51:11.645 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:51:11.645 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.645 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames": [], 2021-07-26T15:51:11.646 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames_s3website": [], 2021-07-26T15:51:11.646 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:51:11.646 INFO:teuthology.orchestra.run.smithi111.stdout: "zones": [ 2021-07-26T15:51:11.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.646 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:51:11.647 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone1", 2021-07-26T15:51:11.647 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:51:11.647 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:51:11.647 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:51:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:51:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:51:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:51:11.648 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T15:51:11.649 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T15:51:11.649 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T15:51:11.649 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:51:11.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.650 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:51:11.650 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone3", 2021-07-26T15:51:11.650 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:51:11.650 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8001" 2021-07-26T15:51:11.651 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.651 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:51:11.651 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:51:11.651 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:51:11.652 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:51:11.652 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "pubsub", 2021-07-26T15:51:11.652 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "false", 2021-07-26T15:51:11.652 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [ 2021-07-26T15:51:11.652 INFO:teuthology.orchestra.run.smithi111.stdout: "test-zone1" 2021-07-26T15:51:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:51:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:51:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T15:51:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T15:51:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8000" 2021-07-26T15:51:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.655 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T15:51:11.655 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T15:51:11.655 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:51:11.655 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T15:51:11.655 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T15:51:11.656 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T15:51:11.656 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T15:51:11.656 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T15:51:11.656 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.657 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.657 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_targets": [ 2021-07-26T15:51:11.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.657 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "default-placement", 2021-07-26T15:51:11.657 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2021-07-26T15:51:11.658 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": [ 2021-07-26T15:51:11.658 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD" 2021-07-26T15:51:11.658 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:51:11.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.659 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.659 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "default-placement", 2021-07-26T15:51:11.659 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:51:11.659 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_policy": { 2021-07-26T15:51:11.659 INFO:teuthology.orchestra.run.smithi111.stdout: "groups": [] 2021-07-26T15:51:11.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.660 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T15:51:11.660 INFO:teuthology.orchestra.run.smithi111.stdout: "short_zone_ids": [ 2021-07-26T15:51:11.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.661 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:51:11.661 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 3535364756 2021-07-26T15:51:11.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.662 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:51:11.662 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 2230137321 2021-07-26T15:51:11.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:51:11.662 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:51:11.663 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 1401765225 2021-07-26T15:51:11.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T15:51:11.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.664 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zonegroup": "test-zonegroup", 2021-07-26T15:51:11.664 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:51:11.664 INFO:teuthology.orchestra.run.smithi111.stdout: "period_config": { 2021-07-26T15:51:11.664 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2021-07-26T15:51:11.664 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T15:51:11.665 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T15:51:11.665 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T15:51:11.666 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T15:51:11.666 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T15:51:11.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.667 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2021-07-26T15:51:11.667 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T15:51:11.667 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T15:51:11.668 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T15:51:11.668 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T15:51:11.668 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T15:51:11.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:51:11.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:51:11.669 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:51:11.669 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_name": "test-realm", 2021-07-26T15:51:11.669 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 3 2021-07-26T15:51:11.669 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:51:11.670 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-07-26T15:52:11.672 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-29 2021-07-26T15:52:11.727 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-30 2021-07-26T15:52:11.756 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:11.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:11.758 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:11.798 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:11.798 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:11.974 INFO:teuthology.orchestra.run.smithi111.stderr:No --period given, using current period=300cac0e-0a1a-420f-8b26-7b3aa1858a04 2021-07-26T15:52:12.005 INFO:teuthology.orchestra.run.smithi111.stdout:[ 2021-07-26T15:52:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:52:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "1_1627314731.751046_259.1", 2021-07-26T15:52:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "2021-07-26T15:52:11.751046Z" 2021-07-26T15:52:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:52:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:52:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:52:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "0.000000" 2021-07-26T15:52:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:52:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:52:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:52:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "0.000000" 2021-07-26T15:52:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:52:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T15:52:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "marker": "", 2021-07-26T15:52:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "last_update": "0.000000" 2021-07-26T15:52:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:52:12.009 INFO:teuthology.orchestra.run.smithi111.stdout:] 2021-07-26T15:52:12.011 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-07-26T15:52:12.011 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:12.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:12.012 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:12.058 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:12.058 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:12.061 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.052+0000 7fbea9903b00 -1 asok(0x55d84ef73720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25046.asok': (13) Permission denied 2021-07-26T15:52:12.151 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:52:12.152 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_status": { 2021-07-26T15:52:12.152 INFO:teuthology.orchestra.run.smithi018.stdout: "info": { 2021-07-26T15:52:12.152 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "sync", 2021-07-26T15:52:12.152 INFO:teuthology.orchestra.run.smithi018.stdout: "num_shards": 4, 2021-07-26T15:52:12.153 INFO:teuthology.orchestra.run.smithi018.stdout: "period": "300cac0e-0a1a-420f-8b26-7b3aa1858a04", 2021-07-26T15:52:12.153 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 3 2021-07-26T15:52:12.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.155 INFO:teuthology.orchestra.run.smithi018.stdout: "markers": [ 2021-07-26T15:52:12.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.156 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 0, 2021-07-26T15:52:12.156 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:52:12.156 INFO:teuthology.orchestra.run.smithi018.stdout: "state": 1, 2021-07-26T15:52:12.157 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314731.751046_259.1", 2021-07-26T15:52:12.157 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:52:12.157 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 55, 2021-07-26T15:52:12.158 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:52:12.158 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "2021-07-26T15:52:11.751046Z", 2021-07-26T15:52:12.158 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 3 2021-07-26T15:52:12.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.159 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 1, 2021-07-26T15:52:12.160 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:52:12.160 INFO:teuthology.orchestra.run.smithi018.stdout: "state": 1, 2021-07-26T15:52:12.161 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:52:12.161 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:52:12.161 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:52:12.162 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:52:12.163 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "0.000000", 2021-07-26T15:52:12.163 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 3 2021-07-26T15:52:12.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.166 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 2, 2021-07-26T15:52:12.166 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:52:12.166 INFO:teuthology.orchestra.run.smithi018.stdout: "state": 1, 2021-07-26T15:52:12.167 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:52:12.167 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:52:12.167 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:52:12.167 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:52:12.168 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "0.000000", 2021-07-26T15:52:12.168 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 3 2021-07-26T15:52:12.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.169 INFO:teuthology.orchestra.run.smithi018.stdout: "key": 3, 2021-07-26T15:52:12.169 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:52:12.169 INFO:teuthology.orchestra.run.smithi018.stdout: "state": 1, 2021-07-26T15:52:12.169 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:52:12.170 INFO:teuthology.orchestra.run.smithi018.stdout: "next_step_marker": "", 2021-07-26T15:52:12.170 INFO:teuthology.orchestra.run.smithi018.stdout: "total_entries": 0, 2021-07-26T15:52:12.170 INFO:teuthology.orchestra.run.smithi018.stdout: "pos": 0, 2021-07-26T15:52:12.170 INFO:teuthology.orchestra.run.smithi018.stdout: "timestamp": "0.000000", 2021-07-26T15:52:12.171 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 3 2021-07-26T15:52:12.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2021-07-26T15:52:12.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.172 INFO:teuthology.orchestra.run.smithi018.stdout: "full_sync": { 2021-07-26T15:52:12.172 INFO:teuthology.orchestra.run.smithi018.stdout: "total": 55, 2021-07-26T15:52:12.172 INFO:teuthology.orchestra.run.smithi018.stdout: "complete": 55 2021-07-26T15:52:12.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.173 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:52:12.174 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-07-26T15:52:12.175 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:12.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:12.176 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:52:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.212+0000 7f24dc70ab00 -1 asok(0x55b8bc3d6720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25125.asok': (13) Permission denied 2021-07-26T15:52:12.241 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.232+0000 7f24dc70ab00 0 NOTICE: overriding master zone: f3aaa2d4-f6fd-4245-876b-7aefbde85e73 2021-07-26T15:52:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.236+0000 7f24dc70ab00 0 failed reading obj info from .rgw.root:zone_info.4501e97d-8506-4dbd-ab21-66d80872cd3a: (2) No such file or directory 2021-07-26T15:52:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.236+0000 7f24dc70ab00 0 WARNING: could not read zone params for zone id=4501e97d-8506-4dbd-ab21-66d80872cd3a name=test-zone3 2021-07-26T15:52:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.236+0000 7f24dc70ab00 0 failed reading obj info from .rgw.root:zone_info.f3aaa2d4-f6fd-4245-876b-7aefbde85e73: (2) No such file or directory 2021-07-26T15:52:12.244 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.236+0000 7f24dc70ab00 0 WARNING: could not read zone params for zone id=f3aaa2d4-f6fd-4245-876b-7aefbde85e73 name=test-zone2 2021-07-26T15:52:12.252 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:52:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:52:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone1", 2021-07-26T15:52:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "domain_root": "test-zone1.rgw.meta:root", 2021-07-26T15:52:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "control_pool": "test-zone1.rgw.control", 2021-07-26T15:52:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "gc_pool": "test-zone1.rgw.log:gc", 2021-07-26T15:52:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "lc_pool": "test-zone1.rgw.log:lc", 2021-07-26T15:52:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "log_pool": "test-zone1.rgw.log", 2021-07-26T15:52:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "intent_log_pool": "test-zone1.rgw.log:intent", 2021-07-26T15:52:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "usage_log_pool": "test-zone1.rgw.log:usage", 2021-07-26T15:52:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "roles_pool": "test-zone1.rgw.meta:roles", 2021-07-26T15:52:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "reshard_pool": "test-zone1.rgw.log:reshard", 2021-07-26T15:52:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "user_keys_pool": "test-zone1.rgw.meta:users.keys", 2021-07-26T15:52:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "user_email_pool": "test-zone1.rgw.meta:users.email", 2021-07-26T15:52:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "user_swift_pool": "test-zone1.rgw.meta:users.swift", 2021-07-26T15:52:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "user_uid_pool": "test-zone1.rgw.meta:users.uid", 2021-07-26T15:52:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "otp_pool": "test-zone1.rgw.otp", 2021-07-26T15:52:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "system_key": { 2021-07-26T15:52:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T15:52:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T15:52:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_pools": [ 2021-07-26T15:52:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "default-placement", 2021-07-26T15:52:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "val": { 2021-07-26T15:52:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "index_pool": "test-zone1.rgw.buckets.index", 2021-07-26T15:52:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_classes": { 2021-07-26T15:52:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "STANDARD": { 2021-07-26T15:52:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "data_pool": "test-zone1.rgw.buckets.data", 2021-07-26T15:52:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "compression_type": "random" 2021-07-26T15:52:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "data_extra_pool": "test-zone1.rgw.buckets.non-ec", 2021-07-26T15:52:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "index_type": 0 2021-07-26T15:52:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:52:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "notif_pool": "test-zone1.rgw.log:notif" 2021-07-26T15:52:12.262 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:52:12.264 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:12.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:12.265 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:52:12.305 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:52:12.300+0000 7fd9b5708b00 -1 asok(0x5635a7902720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25191.asok': (13) Permission denied 2021-07-26T15:52:12.452 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2021-07-26T15:52:12.452 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "0f7fc4e5-d543-4d8a-990f-70c59945239c", 2021-07-26T15:52:12.453 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 1, 2021-07-26T15:52:12.453 INFO:teuthology.orchestra.run.smithi018.stdout: "predecessor_uuid": "300cac0e-0a1a-420f-8b26-7b3aa1858a04", 2021-07-26T15:52:12.453 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_status": [ 2021-07-26T15:52:12.453 INFO:teuthology.orchestra.run.smithi018.stdout: "1_1627314731.751046_259.1", 2021-07-26T15:52:12.454 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2021-07-26T15:52:12.454 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2021-07-26T15:52:12.454 INFO:teuthology.orchestra.run.smithi018.stdout: "" 2021-07-26T15:52:12.455 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.456 INFO:teuthology.orchestra.run.smithi018.stdout: "period_map": { 2021-07-26T15:52:12.456 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "0f7fc4e5-d543-4d8a-990f-70c59945239c", 2021-07-26T15:52:12.456 INFO:teuthology.orchestra.run.smithi018.stdout: "zonegroups": [ 2021-07-26T15:52:12.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.457 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "test-zonegroup", 2021-07-26T15:52:12.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zonegroup", 2021-07-26T15:52:12.457 INFO:teuthology.orchestra.run.smithi018.stdout: "api_name": "", 2021-07-26T15:52:12.458 INFO:teuthology.orchestra.run.smithi018.stdout: "is_master": "true", 2021-07-26T15:52:12.458 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:52:12.458 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:52:12.458 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hostnames": [], 2021-07-26T15:52:12.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hostnames_s3website": [], 2021-07-26T15:52:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:52:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: "zones": [ 2021-07-26T15:52:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.460 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:52:12.461 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone1", 2021-07-26T15:52:12.461 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:52:12.461 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T15:52:12.461 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.462 INFO:teuthology.orchestra.run.smithi018.stdout: "log_meta": "false", 2021-07-26T15:52:12.462 INFO:teuthology.orchestra.run.smithi018.stdout: "log_data": "true", 2021-07-26T15:52:12.462 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:52:12.462 INFO:teuthology.orchestra.run.smithi018.stdout: "read_only": "false", 2021-07-26T15:52:12.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_type": "", 2021-07-26T15:52:12.463 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from_all": "true", 2021-07-26T15:52:12.463 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from": [], 2021-07-26T15:52:12.463 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_zone": "" 2021-07-26T15:52:12.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.464 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:52:12.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone3", 2021-07-26T15:52:12.464 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:52:12.464 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi111.front.sepia.ceph.com:8001" 2021-07-26T15:52:12.465 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_meta": "false", 2021-07-26T15:52:12.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_data": "true", 2021-07-26T15:52:12.465 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:52:12.466 INFO:teuthology.orchestra.run.smithi018.stdout: "read_only": "false", 2021-07-26T15:52:12.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_type": "pubsub", 2021-07-26T15:52:12.466 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from_all": "false", 2021-07-26T15:52:12.466 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from": [ 2021-07-26T15:52:12.467 INFO:teuthology.orchestra.run.smithi018.stdout: "test-zone1" 2021-07-26T15:52:12.467 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.467 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_zone": "" 2021-07-26T15:52:12.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.468 INFO:teuthology.orchestra.run.smithi018.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:52:12.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test-zone2", 2021-07-26T15:52:12.468 INFO:teuthology.orchestra.run.smithi018.stdout: "endpoints": [ 2021-07-26T15:52:12.468 INFO:teuthology.orchestra.run.smithi018.stdout: "http://smithi111.front.sepia.ceph.com:8000" 2021-07-26T15:52:12.469 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.469 INFO:teuthology.orchestra.run.smithi018.stdout: "log_meta": "false", 2021-07-26T15:52:12.469 INFO:teuthology.orchestra.run.smithi018.stdout: "log_data": "true", 2021-07-26T15:52:12.469 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_index_max_shards": 11, 2021-07-26T15:52:12.470 INFO:teuthology.orchestra.run.smithi018.stdout: "read_only": "false", 2021-07-26T15:52:12.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_type": "", 2021-07-26T15:52:12.470 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from_all": "true", 2021-07-26T15:52:12.470 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_from": [], 2021-07-26T15:52:12.471 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_zone": "" 2021-07-26T15:52:12.471 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.471 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.471 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_targets": [ 2021-07-26T15:52:12.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default-placement", 2021-07-26T15:52:12.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2021-07-26T15:52:12.473 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_classes": [ 2021-07-26T15:52:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "STANDARD" 2021-07-26T15:52:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2021-07-26T15:52:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_placement": "default-placement", 2021-07-26T15:52:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:52:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "sync_policy": { 2021-07-26T15:52:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: "groups": [] 2021-07-26T15:52:12.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2021-07-26T15:52:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "short_zone_ids": [ 2021-07-26T15:52:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.476 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:52:12.477 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 3535364756 2021-07-26T15:52:12.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.477 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T15:52:12.478 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 2230137321 2021-07-26T15:52:12.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:52:12.478 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T15:52:12.478 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 1401765225 2021-07-26T15:52:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.479 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2021-07-26T15:52:12.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zonegroup": "test-zonegroup", 2021-07-26T15:52:12.481 INFO:teuthology.orchestra.run.smithi018.stdout: "master_zone": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T15:52:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "period_config": { 2021-07-26T15:52:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_quota": { 2021-07-26T15:52:12.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:52:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:52:12.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:52:12.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:52:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:52:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "user_quota": { 2021-07-26T15:52:12.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2021-07-26T15:52:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2021-07-26T15:52:12.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2021-07-26T15:52:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2021-07-26T15:52:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2021-07-26T15:52:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:52:12.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:52:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T15:52:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_name": "test-realm", 2021-07-26T15:52:12.488 INFO:teuthology.orchestra.run.smithi018.stdout: "realm_epoch": 4 2021-07-26T15:52:12.488 INFO:teuthology.orchestra.run.smithi018.stdout:} 2021-07-26T15:52:12.489 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-07-26T15:53:12.490 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-31 2021-07-26T15:53:12.526 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-32 2021-07-26T15:53:12.556 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:53:12.557 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:53:12.559 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:53:12.560 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8001 2021-07-26T15:53:12.574 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:53:12.574 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:53:12.575 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:53:12.576 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:53:12.576 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 8001: Connection refused 2021-07-26T15:53:13.578 DEBUG:teuthology.orchestra.run.smithi111:> curl http://smithi111.front.sepia.ceph.com:8001 2021-07-26T15:53:13.598 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:53:13.598 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:53:13.599 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-07-26T15:53:13.600 INFO:teuthology.orchestra.run.smithi111.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060feda69-1461-test-zone3","HostId":"1461-test-zone3-test-zonegroup"} 2021-07-26T15:53:13.600 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.602 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:13.644 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:13.645 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:13.648 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:53:13.643+0000 7fea5eba6b00 -1 asok(0x559c4ccc7720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25368.asok': (13) Permission denied 2021-07-26T15:53:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=0f7fc4e5-d543-4d8a-990f-70c59945239c 2021-07-26T15:53:13.758 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:53:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:53:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627314792.520375_65.1", 2021-07-26T15:53:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:53:12.520375Z" 2021-07-26T15:53:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:53:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:53:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:53:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:53:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:53:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:53:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:53:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:53:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:53:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:53:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:53:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:53:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:53:13.762 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:53:13.764 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:53:13.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.765 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:13.808 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:13.808 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:13.999 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:13.999 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:13.999 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:14.000 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:14.000 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:14.000 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:14.002 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:14.002 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:14.002 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:14.005 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:19.008 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.009 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:19.050 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:19.050 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:19.263 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:19.264 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:19.264 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:19.264 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:19.265 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:19.265 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:19.265 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:19.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:19.266 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:19.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:19.267 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:19.268 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:19.268 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:19.268 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:19.268 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:19.270 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:24.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:24.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:24.273 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:24.315 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:24.315 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:24.521 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:24.521 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:24.522 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:24.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:24.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:24.526 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:24.528 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:29.529 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:29.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:29.530 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:29.571 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:29.572 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:29.751 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:29.752 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:29.752 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:29.752 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:29.753 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:29.753 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:29.753 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:29.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:29.754 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:29.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:29.754 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:29.755 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:29.755 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:29.755 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:29.756 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:29.757 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:34.758 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:34.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:34.759 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:34.801 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:34.802 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:35.018 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:35.019 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:35.019 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:35.019 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:35.020 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:35.020 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:35.020 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:35.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:35.021 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:35.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:35.021 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:35.021 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:35.021 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:35.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:35.022 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:35.022 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:40.027 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:40.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:40.028 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:40.070 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:40.071 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:40.267 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:40.268 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:40.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:40.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:40.270 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:40.272 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:45.274 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:45.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:45.276 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:45.319 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:45.319 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:45.521 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:45.522 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:45.523 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:45.524 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:45.526 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:45.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:45.527 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:45.528 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:50.530 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:50.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:50.531 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:50.573 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:50.573 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:50.781 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:50.781 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:50.781 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:50.782 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:50.782 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:50.782 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:50.783 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:50.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:50.783 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:50.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:50.784 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:50.784 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:50.784 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:50.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:50.786 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:50.787 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:53:55.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:55.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:55.790 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:55.831 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:55.831 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:56.040 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:53:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:53:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:53:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:53:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:53:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:53:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:53:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:53:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:53:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:53:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:53:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:53:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:53:56.043 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:53:56.045 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:01.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:01.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:01.047 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:01.091 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:01.091 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:01.302 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:01.302 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:01.302 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:01.303 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:01.303 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:01.303 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:01.303 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:01.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:01.304 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:01.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:01.304 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:01.304 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:01.305 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:01.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:01.305 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:01.306 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:06.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:06.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:06.309 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:06.350 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:06.350 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:06.553 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:06.554 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:06.557 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:06.557 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:06.557 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:06.557 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:06.558 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:06.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:06.559 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:06.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:06.561 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:06.561 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:06.562 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:06.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:06.562 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:06.563 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:11.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:11.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:11.570 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:11.612 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:11.613 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:11.826 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:11.826 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:11.827 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:11.827 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:11.827 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:11.827 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:11.828 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:11.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:11.828 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:11.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:11.828 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:11.829 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:11.829 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:11.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:11.829 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:11.831 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:16.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:16.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:16.834 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:16.876 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:16.877 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:17.089 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:17.093 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:17.094 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:22.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:22.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:22.097 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:22.138 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:22.139 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:22.338 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:22.338 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:22.339 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:22.339 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:22.339 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:22.339 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:22.339 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:22.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:22.340 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:22.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:22.340 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:22.341 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:22.341 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:22.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:22.341 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:22.343 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:27.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:27.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:27.347 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:27.387 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:27.387 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:27.609 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:27.609 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:27.610 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:27.611 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:27.611 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:27.611 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:27.612 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:27.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:27.612 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:27.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:27.612 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:27.613 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:27.614 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:27.614 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:27.614 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:27.615 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:32.618 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.619 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:32.659 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:32.659 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:32.872 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:32.872 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:32.873 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:32.873 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:32.873 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:32.873 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:32.874 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:32.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:32.874 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:32.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:32.875 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:32.875 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:32.875 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:32.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:32.875 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:32.876 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:37.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:37.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:37.879 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:37.921 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:37.922 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:38.126 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:38.126 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:38.126 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:38.126 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:38.127 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:38.127 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:38.127 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:38.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:38.128 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:38.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:38.128 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:38.128 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:38.129 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:38.129 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:38.129 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:38.130 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:43.132 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:43.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:43.133 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:43.174 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:43.174 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:43.391 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:43.395 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:43.395 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:48.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:48.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:48.398 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:48.440 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:48.441 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:48.648 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:48.652 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:48.653 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:53.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.656 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:53.698 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:53.699 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:53.905 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:53.905 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:53.905 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:53.905 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:53.906 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:53.906 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:53.906 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:53.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:53.907 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:53.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:53.907 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:53.907 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:53.908 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:53.908 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:53.908 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:53.909 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:54:58.911 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.912 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:58.955 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:58.956 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:54:59.172 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:04.173 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.176 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:04.217 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:04.217 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:04.450 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:04.451 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:04.452 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:04.453 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:04.454 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:04.457 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:09.458 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.460 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:09.503 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:09.504 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:09.702 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:09.703 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:09.703 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:09.703 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:09.703 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:09.704 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:09.704 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:09.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:09.704 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:09.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:09.705 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:09.705 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:09.705 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:09.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:09.706 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:09.707 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:14.709 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:14.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:14.711 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:14.751 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:14.751 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:14.970 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:14.970 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:14.971 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:14.971 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:14.971 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:14.971 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:14.972 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:14.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:14.972 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:14.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:14.973 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:14.973 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:14.974 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:14.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:14.974 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:14.974 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:19.976 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.977 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:20.019 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:20.019 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:20.220 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:20.220 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:20.221 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:20.221 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:20.221 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:20.221 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:20.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:20.224 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:20.225 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:20.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:20.225 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:20.227 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:25.228 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:25.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:25.229 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:25.271 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:25.272 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:25.471 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:25.472 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:25.472 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:25.472 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:25.473 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:25.473 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:25.473 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:25.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:25.473 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:25.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:25.474 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:25.474 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:25.474 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:25.475 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:25.475 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:25.476 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:30.478 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.479 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:30.522 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:30.523 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:30.707 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:30.710 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:30.711 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:35.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:35.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:35.714 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:35.757 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:35.757 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:35.964 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:35.965 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:35.965 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:35.966 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:35.966 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:35.966 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:35.966 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:35.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:35.967 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:35.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:35.969 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:35.970 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:35.971 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:35.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:35.971 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:35.973 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:40.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:40.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:40.980 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:41.022 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:41.022 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:41.226 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:41.226 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:41.227 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:41.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:41.229 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:41.229 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:41.231 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:46.232 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:46.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:46.234 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:46.277 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:46.277 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:46.492 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:46.493 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:46.493 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:46.493 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:46.493 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:46.494 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:46.494 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:46.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:46.494 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:46.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:46.495 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:46.495 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:46.495 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:46.495 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:46.496 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:46.497 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:51.498 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:51.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:51.501 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:51.542 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:51.542 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:51.735 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:51.735 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:51.736 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:51.737 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:51.738 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:51.738 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:51.739 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:55:56.747 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:56.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:56.751 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:56.795 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:56.795 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:56.996 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:55:56.996 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:55:56.996 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:55:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:55:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:55:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:55:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:55:56.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:56.998 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:55:56.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:55:56.998 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:55:56.999 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:55:56.999 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:55:56.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:55:56.999 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:55:57.000 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:02.002 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:02.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:02.003 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:02.045 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:02.046 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:02.253 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:02.254 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:02.254 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:02.254 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:02.255 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:02.255 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:02.256 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:02.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:02.256 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:02.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:02.257 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:02.257 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:02.257 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:02.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:02.258 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:02.260 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:07.262 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:07.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:07.263 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:07.307 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:07.307 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:07.523 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:07.530 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:07.531 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:12.532 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:12.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:12.534 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:12.578 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:12.578 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:12.795 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:12.796 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:12.796 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:12.796 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:12.797 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:12.797 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:12.797 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:12.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:12.798 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:12.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:12.798 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:12.798 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:12.799 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:12.799 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:12.799 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:12.800 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:17.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:17.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:17.803 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:17.848 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:17.848 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:18.046 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:18.047 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:18.047 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:18.047 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:18.047 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:18.048 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:18.048 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:18.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:18.048 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:18.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:18.049 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:18.049 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:18.049 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:18.049 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:18.050 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:18.051 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:23.052 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:23.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:23.054 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:23.095 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:23.096 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:23.303 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:23.303 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:23.303 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:23.304 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:23.304 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:23.304 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:23.304 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:23.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:23.305 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:23.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:23.305 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:23.305 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:23.306 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:23.306 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:23.306 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:23.308 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:28.311 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:28.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:28.313 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:28.354 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:28.354 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:28.564 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:28.565 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:28.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:28.568 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:28.569 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:33.569 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:33.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:33.571 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:33.615 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:33.615 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:33.809 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:33.809 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:33.810 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:33.811 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:33.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:33.813 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:33.814 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:38.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:38.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:38.818 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:39.054 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:39.055 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:39.056 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:39.056 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:39.057 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:39.057 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:39.057 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:39.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:39.058 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:39.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:39.058 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:39.058 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:39.059 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:39.059 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:39.059 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:39.060 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:44.063 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:44.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:44.065 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:44.108 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:44.108 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:44.317 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:44.319 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:44.320 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:44.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:44.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:44.323 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:44.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:44.325 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:44.328 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:49.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:49.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:49.330 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:49.370 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:49.371 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:49.574 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:49.575 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:49.575 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:49.575 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:49.575 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:49.576 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:49.576 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:49.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:49.577 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:49.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:49.577 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:49.578 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:49.578 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:49.578 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:49.579 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:49.579 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:54.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:54.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:54.582 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:54.624 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:54.624 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:54.836 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:56:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:56:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:56:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:56:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:56:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:56:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:56:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:56:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:56:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:56:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:56:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:56:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:56:54.840 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:56:54.841 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:56:59.842 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:59.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:59.844 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:59.887 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:00.097 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:00.098 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:00.098 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:00.098 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:00.098 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:00.099 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:00.099 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:00.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:00.099 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:00.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:00.100 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:00.100 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:00.100 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:00.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:00.101 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:00.104 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:05.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:05.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:05.108 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:05.149 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:05.149 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:05.345 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:05.346 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:05.346 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:05.346 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:05.347 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:05.347 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:05.347 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:05.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:05.348 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:05.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:05.348 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:05.348 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:05.349 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:05.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:05.349 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:05.351 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:10.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:10.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:10.355 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:10.402 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:10.402 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:10.606 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:10.607 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:10.608 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:10.609 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:10.610 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:10.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:10.611 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:10.613 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:15.614 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:15.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:15.617 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:15.662 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:15.663 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:15.866 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:15.867 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:15.867 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:15.867 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:15.868 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:15.868 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:15.868 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:15.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:15.869 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:15.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:15.869 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:15.869 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:15.869 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:15.870 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:15.870 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:15.871 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:20.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:20.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:20.874 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:20.916 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:20.916 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:21.114 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:21.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:21.115 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:21.115 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:21.115 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:21.116 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:21.116 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:21.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:21.116 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:21.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:21.117 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:21.117 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:21.117 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:21.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:21.118 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:21.119 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:26.120 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:26.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:26.122 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:26.369 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:26.370 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:26.370 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:26.371 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:26.371 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:26.371 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:26.372 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:26.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:26.373 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:26.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:26.374 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:26.374 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:26.375 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:26.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:26.376 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:26.378 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:31.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:31.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:31.381 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:31.423 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:31.424 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:31.657 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:31.658 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:31.659 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:31.660 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:31.661 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:31.663 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:36.664 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:36.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:36.666 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:36.710 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:36.710 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:36.927 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:36.928 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:36.928 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:36.928 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:36.928 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:36.929 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:36.929 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:36.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:36.929 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:36.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:36.930 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:36.930 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:36.930 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:36.931 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:36.931 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:36.932 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:41.933 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:41.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:41.935 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:42.179 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:42.179 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:42.179 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:42.180 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:42.180 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:42.180 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:42.180 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:42.182 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:42.183 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:47.185 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:47.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:47.187 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:47.227 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:47.228 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:47.440 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:47.440 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:47.441 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:47.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:47.443 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:47.444 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:47.445 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:52.446 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:52.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:52.448 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:52.491 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:52.491 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:52.705 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:52.705 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:52.706 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:52.706 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:52.707 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:52.707 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:52.707 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:52.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:52.709 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:52.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:52.709 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:52.710 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:52.710 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:52.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:52.712 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:52.714 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:57:57.715 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:57.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:57.717 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:57.968 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:57:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:57:57.968 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:57:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:57:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:57:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:57:57.969 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:57:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:57:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:57:57.970 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:57:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:57:57.971 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:57:57.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:57:57.972 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:57:57.974 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:02.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:02.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:02.980 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:03.023 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:03.024 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:03.231 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:03.231 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:03.231 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:03.232 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:03.232 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:03.232 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:03.232 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:03.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:03.233 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:03.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:03.233 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:03.233 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:03.234 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:03.234 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:03.235 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:08.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:08.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:08.238 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:08.281 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:08.281 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:08.501 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:08.502 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:08.502 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:08.504 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:08.505 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:08.505 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:08.505 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:08.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:08.506 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:08.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:08.506 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:08.506 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:08.507 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:08.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:08.509 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:08.511 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:13.513 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:13.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:13.515 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:13.559 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:13.559 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:13.748 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:13.748 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:13.748 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:13.749 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:13.749 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:13.749 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:13.749 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:13.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:13.750 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:13.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:13.750 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:13.750 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:13.751 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:13.751 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:13.751 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:13.752 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:18.755 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:18.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:18.756 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:18.800 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:18.801 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:19.017 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:19.017 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:19.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:19.019 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:19.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:19.020 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:19.021 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:24.022 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:24.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:24.024 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:24.067 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:24.067 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:24.270 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:24.270 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:24.270 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:24.271 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:24.271 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:24.271 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:24.271 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:24.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:24.272 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:24.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:24.273 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:24.273 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:24.273 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:24.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:24.273 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:24.275 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:29.277 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... FAIL 2021-07-26T15:58:29.280 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-33 2021-07-26T15:58:29.317 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=tnoxkv-34 2021-07-26T15:58:29.443 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.444 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:29.489 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:29.490 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:29.492 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T15:58:29.487+0000 7f5b084f8b00 -1 asok(0x55a2e6831720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25451.asok': (13) Permission denied 2021-07-26T15:58:29.508 INFO:tasks.rgw.c1.client.0.smithi018.stdout:2021-07-26T15:58:29.503+0000 7f3c1a7fc700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:58:29.511 INFO:tasks.rgw.c1.client.0.smithi018.stdout:2021-07-26T15:58:29.507+0000 7f3c0cff1700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:58:29.572 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=0f7fc4e5-d543-4d8a-990f-70c59945239c 2021-07-26T15:58:29.601 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T15:58:29.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:58:29.601 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627315109.309891_70.1", 2021-07-26T15:58:29.602 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T15:58:29.309891Z" 2021-07-26T15:58:29.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:58:29.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:58:29.602 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:58:29.603 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:58:29.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:58:29.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:58:29.603 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:58:29.603 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:58:29.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T15:58:29.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T15:58:29.604 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T15:58:29.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T15:58:29.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T15:58:29.605 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T15:58:29.606 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:58:29.607 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.608 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:29.655 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:29.655 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:29.879 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:29.879 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:29.880 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:29.881 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:29.882 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:29.882 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:29.884 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:32.880 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T15:58:32.875+0000 7f6d387f0700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:58:34.885 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:34.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:34.887 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:34.929 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:34.929 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:35.130 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:35.130 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:35.131 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:35.131 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:35.131 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:35.131 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:35.132 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:35.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:35.132 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:35.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:35.132 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:35.133 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:35.133 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:35.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:35.133 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:35.135 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:40.136 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:40.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:40.138 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:40.180 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:40.180 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:40.393 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:40.393 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:40.394 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:40.394 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:40.394 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:40.395 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:40.395 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:40.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:40.395 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:40.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:40.396 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:40.396 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:40.396 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:40.397 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:40.397 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:40.398 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:43.149 INFO:tasks.rgw.c2.client.0.smithi111.stdout:2021-07-26T15:58:43.142+0000 7f90eb7f6700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:58:45.400 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:45.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:45.401 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:45.659 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:45.659 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:45.659 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:45.660 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:45.660 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:45.660 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:45.660 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:45.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:45.661 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:45.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:45.661 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:45.661 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:45.662 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:45.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:45.662 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:45.663 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:50.665 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:50.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:50.667 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:50.704 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:50.705 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:50.920 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:50.921 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:50.921 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:50.921 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:50.921 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:50.921 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:50.922 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:50.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:50.922 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:50.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:50.923 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:50.923 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:50.923 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:50.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:50.923 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:50.925 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:58:55.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:55.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:55.927 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:55.970 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:55.971 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:56.198 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:58:56.199 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:58:56.199 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:58:56.199 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:58:56.199 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:58:56.200 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:58:56.200 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:58:56.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:56.200 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:58:56.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:58:56.201 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:58:56.201 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:58:56.201 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:58:56.201 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:58:56.202 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:58:56.203 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:01.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:01.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:01.207 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:01.251 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:01.252 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:01.459 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:01.460 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:01.461 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:01.461 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:01.461 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:01.461 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:01.462 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:01.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:01.462 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:01.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:01.463 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:01.463 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:01.463 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:01.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:01.463 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:01.465 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:06.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:06.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:06.468 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:06.509 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:06.509 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:06.715 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:06.716 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:06.716 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:06.716 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:06.717 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:06.717 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:06.717 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:06.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:06.718 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:06.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:06.718 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:06.719 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:06.719 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:06.719 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:06.719 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:06.720 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:11.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:11.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:11.724 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:11.765 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:11.765 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:11.982 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:11.986 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:11.987 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:16.988 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:16.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:16.990 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:17.031 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:17.031 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:17.248 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:17.248 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:17.248 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:17.248 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:17.249 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:17.249 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:17.250 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:17.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:17.250 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:17.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:17.251 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:17.251 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:17.251 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:17.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:17.252 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:17.253 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:22.255 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:22.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:22.256 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:22.295 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:22.296 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:22.501 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:22.501 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:22.502 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:22.502 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:22.502 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:22.502 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:22.503 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:22.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:22.503 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:22.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:22.504 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:22.504 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:22.504 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:22.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:22.504 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:22.506 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:27.507 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:27.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:27.509 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:27.550 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:27.550 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:27.733 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:27.733 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:27.733 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:27.733 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:27.734 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:27.734 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:27.734 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:27.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:27.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:27.736 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:27.737 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:32.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:32.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:32.740 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:32.782 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:32.783 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:32.984 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:32.985 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:32.985 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:32.985 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:32.986 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:32.986 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:32.986 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:32.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:32.987 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:32.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:32.987 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:32.987 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:32.987 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:32.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:32.988 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:32.989 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:37.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:37.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:37.993 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:38.036 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:38.036 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:38.250 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:38.250 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:38.251 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:38.252 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:38.253 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:38.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:38.255 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:38.256 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:43.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:43.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:43.258 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:43.301 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:43.301 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:43.517 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:43.518 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:43.518 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:43.518 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:43.518 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:43.519 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:43.519 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:43.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:43.519 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:43.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:43.520 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:43.520 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:43.520 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:43.521 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:43.521 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:43.522 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:48.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:48.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:48.524 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:48.567 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:48.567 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:48.785 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:48.786 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:48.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:48.788 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:48.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:48.789 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:48.790 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:53.791 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:53.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:53.792 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:53.833 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:53.833 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:54.044 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:54.045 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:54.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:54.047 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:54.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:54.048 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:54.049 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T15:59:59.051 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:59.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:59.053 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:59.097 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:59.097 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:59.309 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T15:59:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T15:59:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T15:59:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T15:59:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T15:59:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T15:59:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T15:59:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T15:59:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T15:59:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T15:59:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T15:59:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T15:59:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T15:59:59.313 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T15:59:59.314 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:04.315 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:04.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:04.316 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:04.361 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:04.361 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:04.580 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:04.580 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:04.580 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:04.581 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:04.581 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:04.581 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:04.581 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:04.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:04.582 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:04.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:04.582 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:04.583 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:04.583 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:04.583 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:04.584 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:04.585 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:09.586 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:09.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:09.588 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:09.635 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:09.636 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:09.826 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:09.826 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:09.828 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:09.828 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:09.828 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:09.829 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:09.829 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:09.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:09.829 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:09.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:09.830 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:09.830 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:09.830 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:09.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:09.831 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:09.832 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:14.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:14.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:14.835 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:14.877 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:14.877 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:15.087 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:15.087 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:15.088 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:15.088 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:15.088 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:15.089 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:15.089 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:15.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:15.089 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:15.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:15.091 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:15.091 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:15.091 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:15.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:15.092 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:15.093 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:20.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:20.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:20.095 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:20.138 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:20.138 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:20.351 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:20.352 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:20.352 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:20.352 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:20.352 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:20.353 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:20.353 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:20.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:20.353 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:20.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:20.354 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:20.354 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:20.354 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:20.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:20.355 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:20.356 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:25.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:25.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:25.359 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:25.401 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:25.401 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:25.622 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:25.623 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:25.623 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:25.624 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:25.624 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:25.624 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:25.624 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:25.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:25.625 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:25.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:25.625 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:25.626 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:25.626 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:25.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:25.626 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:25.628 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:30.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:30.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:30.630 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:30.672 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:30.673 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:30.880 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:30.881 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:30.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:30.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:30.884 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:30.885 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:35.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:35.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:35.888 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:35.930 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:35.930 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:36.144 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:36.144 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:36.145 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:36.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:36.147 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:36.148 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:36.149 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:41.150 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:41.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:41.152 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:41.195 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:41.195 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:41.403 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:41.403 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:41.404 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:41.404 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:41.404 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:41.404 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:41.405 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:41.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:41.405 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:41.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:41.406 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:41.406 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:41.406 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:41.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:41.406 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:41.408 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:46.409 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.411 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:46.455 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:46.455 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:46.682 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:46.685 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:46.687 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:51.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:51.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:51.692 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:51.735 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:51.736 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:51.946 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:51.947 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:51.947 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:51.947 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:51.947 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:51.948 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:51.948 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:51.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:51.948 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:51.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:51.949 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:51.949 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:51.949 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:51.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:51.950 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:51.950 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:00:56.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:56.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:56.953 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:56.995 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:56.995 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:57.218 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:00:57.218 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:00:57.218 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:00:57.219 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:00:57.219 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:00:57.219 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:00:57.220 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:00:57.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:57.220 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:00:57.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:00:57.221 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:00:57.221 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:00:57.221 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:00:57.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:00:57.222 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:00:57.223 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:02.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:02.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:02.227 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:02.267 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:02.267 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:02.474 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:02.474 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:02.474 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:02.475 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:02.475 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:02.475 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:02.475 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:02.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:02.476 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:02.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:02.476 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:02.476 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:02.477 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:02.477 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:02.477 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:02.478 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:07.480 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.482 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:07.522 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:07.522 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:07.718 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:07.718 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:07.719 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:07.719 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:07.720 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:07.720 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:07.721 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:07.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:07.722 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:07.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:07.724 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:07.724 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:07.724 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:07.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:07.725 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:07.726 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:12.728 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:12.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:12.729 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:12.772 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:12.772 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:13.004 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:13.004 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:13.005 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:13.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:13.007 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:13.008 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:13.008 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:13.010 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:18.011 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:18.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:18.012 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:18.053 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:18.054 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:18.252 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:18.253 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:18.253 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:18.253 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:18.254 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:18.254 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:18.254 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:18.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:18.255 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:18.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:18.255 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:18.255 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:18.255 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:18.256 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:18.256 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:18.257 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:23.262 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:23.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:23.263 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:23.515 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:23.515 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:23.516 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:23.516 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:23.516 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:23.517 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:23.517 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:23.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:23.517 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:23.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:23.518 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:23.518 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:23.518 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:23.518 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:23.519 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:23.520 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:28.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:28.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:28.522 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:28.564 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:28.564 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:28.781 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:28.785 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:28.786 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:33.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:33.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:33.789 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:33.831 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:33.831 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:34.041 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:34.042 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:34.043 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:34.044 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:34.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:34.045 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:34.046 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:39.047 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:39.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:39.049 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:39.089 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:39.089 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:39.298 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:39.298 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:39.299 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:39.299 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:39.299 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:39.299 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:39.300 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:39.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:39.300 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:39.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:39.301 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:39.302 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:39.303 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:44.305 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:44.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:44.306 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:44.350 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:44.351 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:44.578 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:44.578 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:44.579 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:44.579 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:44.580 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:44.580 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:44.580 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:44.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:44.581 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:44.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:44.581 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:44.581 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:44.582 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:44.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:44.582 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:44.583 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:49.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:49.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:49.586 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:49.631 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:49.631 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:49.826 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:49.826 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:49.827 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:49.827 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:49.827 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:49.827 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:49.828 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:49.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:49.828 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:49.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:49.829 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:49.829 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:49.829 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:49.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:49.829 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:49.831 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:01:54.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:54.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:54.833 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:54.873 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:54.874 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:55.086 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:01:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:01:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:01:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:01:55.087 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:01:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:01:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:01:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:55.088 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:01:55.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:01:55.089 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:01:55.089 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:01:55.089 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:01:55.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:01:55.090 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:01:55.091 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:00.092 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:00.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:00.094 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:00.134 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:00.134 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:00.337 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:00.337 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:00.337 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:00.338 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:00.338 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:00.338 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:00.338 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:00.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:00.339 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:00.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:00.339 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:00.340 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:00.340 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:00.340 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:00.340 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:00.341 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:05.343 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:05.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:05.347 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:05.390 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:05.390 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:05.604 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:05.604 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:05.605 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:05.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:05.607 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:05.608 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:05.608 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:05.609 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:10.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:10.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:10.612 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:10.657 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:10.657 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:10.853 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:10.854 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:10.854 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:10.854 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:10.854 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:10.855 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:10.855 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:10.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:10.855 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:10.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:10.859 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:10.859 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:10.859 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:10.860 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:10.860 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:10.861 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:15.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:15.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:15.864 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:15.905 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:15.905 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:16.116 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:16.117 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:16.117 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:16.117 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:16.117 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:16.117 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:16.118 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:16.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:16.118 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:16.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:16.119 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:16.119 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:16.119 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:16.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:16.120 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:16.121 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:21.123 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:21.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:21.124 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:21.371 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:21.371 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:21.372 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:21.372 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:21.373 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:21.373 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:21.374 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:21.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:21.374 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:21.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:21.375 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:21.375 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:21.375 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:21.376 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:21.376 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:21.377 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:26.378 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:26.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:26.379 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:26.423 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:26.638 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:26.638 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:26.638 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:26.639 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:26.639 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:26.639 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:26.639 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:26.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:26.640 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:26.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:26.640 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:26.640 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:26.641 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:26.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:26.642 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:26.643 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:31.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:31.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:31.646 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:31.686 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:31.687 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:31.885 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:31.885 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:31.885 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:31.887 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:31.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:31.889 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:31.890 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:31.890 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:31.892 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:36.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:36.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:36.897 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:36.941 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:36.942 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:37.159 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:37.160 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:37.161 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:37.162 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:37.163 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:37.163 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:37.165 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:42.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:42.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:42.169 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:42.209 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:42.210 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:42.414 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:42.415 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:42.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:42.417 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:42.418 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:42.418 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:42.419 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:47.421 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:47.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:47.423 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:47.464 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:47.465 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:47.663 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:47.664 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:47.665 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:47.665 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:47.665 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:47.665 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:47.666 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:47.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:47.666 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:47.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:47.667 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:47.667 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:47.667 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:47.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:47.668 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:47.669 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:52.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:52.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:52.673 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:52.934 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:52.935 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:52.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:52.937 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:52.937 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:52.941 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:02:57.942 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:57.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:57.944 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:58.190 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:02:58.191 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:02:58.191 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:02:58.191 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:02:58.192 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:02:58.192 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:02:58.192 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:02:58.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:58.193 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:02:58.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:02:58.193 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:02:58.194 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:02:58.194 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:02:58.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:02:58.194 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:02:58.196 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:03.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:03.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:03.201 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:03.244 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:03.330 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:03.448 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:03.448 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:03.449 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:03.449 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:03.450 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:03.450 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:03.451 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:03.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:03.452 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:03.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:03.452 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:03.453 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:03.453 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:03.454 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:03.454 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:03.456 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:08.458 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:08.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:08.459 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:08.498 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:08.499 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:08.718 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:08.718 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:08.718 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:08.719 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:08.719 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:08.721 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:08.721 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:08.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:08.722 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:08.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:08.722 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:08.722 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:08.723 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:08.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:08.723 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:08.724 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:13.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:13.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:13.727 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:13.771 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:13.771 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:13.997 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:13.998 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:13.999 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:13.999 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:13.999 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:14.000 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:14.000 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:14.001 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:14.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:14.002 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:14.002 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:14.003 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:14.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:14.007 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:19.008 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:19.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:19.011 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:19.056 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:19.057 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:19.283 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:19.284 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:19.284 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:19.284 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:19.285 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:19.285 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:19.285 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:19.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:19.285 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:19.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:19.286 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:19.286 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:19.286 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:19.287 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:19.287 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:19.287 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:24.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:24.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:24.293 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:24.336 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:24.337 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:24.554 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:24.555 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:24.556 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:24.557 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:24.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:24.558 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:24.559 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:29.560 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:29.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:29.561 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:29.609 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:29.610 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:29.821 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:29.821 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:29.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:29.823 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:29.824 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:29.824 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:29.825 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:34.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:34.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:34.827 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:34.868 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:34.869 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:35.091 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:35.091 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:35.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:35.093 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:35.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:35.093 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:35.093 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:35.094 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:35.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:35.094 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:35.097 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:40.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:40.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:40.099 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:40.141 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:40.142 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:40.352 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:40.353 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:03:40.353 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:03:40.353 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:03:40.353 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:03:40.354 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:03:40.354 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:03:40.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:40.355 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:03:40.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:40.355 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:03:40.355 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:03:40.356 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:03:40.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:40.356 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:40.357 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=4 2021-07-26T16:03:45.360 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... FAIL 2021-07-26T16:03:45.361 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:03:45.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:03:45.362 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T16:03:45.403 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:45.404 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:45.432 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T16:03:45.426+0000 7fedf535cb00 0 failed reading obj info from .rgw.root:zone_info.112afa81-a585-483c-a26d-c230749bfd0c: (2) No such file or directory 2021-07-26T16:03:45.432 INFO:teuthology.orchestra.run.smithi111.stderr:2021-07-26T16:03:45.426+0000 7fedf535cb00 0 WARNING: could not read zone params for zone id=112afa81-a585-483c-a26d-c230749bfd0c name=test-zone1 2021-07-26T16:03:45.444 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:45.444 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T16:03:45.444 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T16:03:45.444 INFO:teuthology.orchestra.run.smithi111.stdout: "domain_root": "test-zone2.rgw.meta:root", 2021-07-26T16:03:45.445 INFO:teuthology.orchestra.run.smithi111.stdout: "control_pool": "test-zone2.rgw.control", 2021-07-26T16:03:45.445 INFO:teuthology.orchestra.run.smithi111.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2021-07-26T16:03:45.445 INFO:teuthology.orchestra.run.smithi111.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2021-07-26T16:03:45.445 INFO:teuthology.orchestra.run.smithi111.stdout: "log_pool": "test-zone2.rgw.log", 2021-07-26T16:03:45.446 INFO:teuthology.orchestra.run.smithi111.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2021-07-26T16:03:45.446 INFO:teuthology.orchestra.run.smithi111.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2021-07-26T16:03:45.446 INFO:teuthology.orchestra.run.smithi111.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2021-07-26T16:03:45.446 INFO:teuthology.orchestra.run.smithi111.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2021-07-26T16:03:45.447 INFO:teuthology.orchestra.run.smithi111.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2021-07-26T16:03:45.447 INFO:teuthology.orchestra.run.smithi111.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2021-07-26T16:03:45.447 INFO:teuthology.orchestra.run.smithi111.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2021-07-26T16:03:45.447 INFO:teuthology.orchestra.run.smithi111.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2021-07-26T16:03:45.447 INFO:teuthology.orchestra.run.smithi111.stdout: "otp_pool": "test-zone2.rgw.otp", 2021-07-26T16:03:45.448 INFO:teuthology.orchestra.run.smithi111.stdout: "system_key": { 2021-07-26T16:03:45.448 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "SDF05H202F7UMMJ8", 2021-07-26T16:03:45.448 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "VzxTWSiVT8wZ83eRL1CUtzB0lYk46gFi" 2021-07-26T16:03:45.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.449 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_pools": [ 2021-07-26T16:03:45.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.449 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "default-placement", 2021-07-26T16:03:45.449 INFO:teuthology.orchestra.run.smithi111.stdout: "val": { 2021-07-26T16:03:45.449 INFO:teuthology.orchestra.run.smithi111.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2021-07-26T16:03:45.450 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": { 2021-07-26T16:03:45.450 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD": { 2021-07-26T16:03:45.450 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pool": "test-zone2.rgw.buckets.data", 2021-07-26T16:03:45.450 INFO:teuthology.orchestra.run.smithi111.stdout: "compression_type": "random" 2021-07-26T16:03:45.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.452 INFO:teuthology.orchestra.run.smithi111.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2021-07-26T16:03:45.452 INFO:teuthology.orchestra.run.smithi111.stdout: "index_type": 0 2021-07-26T16:03:45.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.452 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.453 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.453 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T16:03:45.453 INFO:teuthology.orchestra.run.smithi111.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2021-07-26T16:03:45.453 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:45.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:03:45.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:03:45.456 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T16:03:45.496 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:45.496 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:45.732 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:03:45.732 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "300cac0e-0a1a-420f-8b26-7b3aa1858a04", 2021-07-26T16:03:45.732 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 2, 2021-07-26T16:03:45.733 INFO:teuthology.orchestra.run.smithi111.stdout: "predecessor_uuid": "148a74da-a164-4b33-8c58-4bf793871dd4", 2021-07-26T16:03:45.733 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": [ 2021-07-26T16:03:45.733 INFO:teuthology.orchestra.run.smithi111.stdout: "1_1627314643.353553_212.1", 2021-07-26T16:03:45.733 INFO:teuthology.orchestra.run.smithi111.stdout: "1_1627314203.666519_93.1", 2021-07-26T16:03:45.734 INFO:teuthology.orchestra.run.smithi111.stdout: "", 2021-07-26T16:03:45.734 INFO:teuthology.orchestra.run.smithi111.stdout: "" 2021-07-26T16:03:45.734 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.734 INFO:teuthology.orchestra.run.smithi111.stdout: "period_map": { 2021-07-26T16:03:45.735 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "300cac0e-0a1a-420f-8b26-7b3aa1858a04", 2021-07-26T16:03:45.735 INFO:teuthology.orchestra.run.smithi111.stdout: "zonegroups": [ 2021-07-26T16:03:45.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.735 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "test-zonegroup", 2021-07-26T16:03:45.736 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zonegroup", 2021-07-26T16:03:45.736 INFO:teuthology.orchestra.run.smithi111.stdout: "api_name": "", 2021-07-26T16:03:45.736 INFO:teuthology.orchestra.run.smithi111.stdout: "is_master": "true", 2021-07-26T16:03:45.736 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T16:03:45.736 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T16:03:45.737 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.737 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames": [], 2021-07-26T16:03:45.737 INFO:teuthology.orchestra.run.smithi111.stdout: "hostnames_s3website": [], 2021-07-26T16:03:45.737 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T16:03:45.738 INFO:teuthology.orchestra.run.smithi111.stdout: "zones": [ 2021-07-26T16:03:45.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.738 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T16:03:45.740 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone1", 2021-07-26T16:03:45.741 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T16:03:45.741 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi018.front.sepia.ceph.com:8000" 2021-07-26T16:03:45.742 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.742 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T16:03:45.742 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T16:03:45.742 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T16:03:45.743 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T16:03:45.743 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T16:03:45.743 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "true", 2021-07-26T16:03:45.743 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T16:03:45.744 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T16:03:45.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.744 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T16:03:45.745 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone3", 2021-07-26T16:03:45.745 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T16:03:45.745 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8001" 2021-07-26T16:03:45.746 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.746 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T16:03:45.746 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T16:03:45.746 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T16:03:45.746 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T16:03:45.747 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "pubsub", 2021-07-26T16:03:45.747 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "false", 2021-07-26T16:03:45.747 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [ 2021-07-26T16:03:45.748 INFO:teuthology.orchestra.run.smithi111.stdout: "test-zone1" 2021-07-26T16:03:45.748 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.748 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T16:03:45.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.749 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T16:03:45.749 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "test-zone2", 2021-07-26T16:03:45.749 INFO:teuthology.orchestra.run.smithi111.stdout: "endpoints": [ 2021-07-26T16:03:45.750 INFO:teuthology.orchestra.run.smithi111.stdout: "http://smithi111.front.sepia.ceph.com:8000" 2021-07-26T16:03:45.750 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.750 INFO:teuthology.orchestra.run.smithi111.stdout: "log_meta": "false", 2021-07-26T16:03:45.750 INFO:teuthology.orchestra.run.smithi111.stdout: "log_data": "true", 2021-07-26T16:03:45.751 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_index_max_shards": 11, 2021-07-26T16:03:45.751 INFO:teuthology.orchestra.run.smithi111.stdout: "read_only": "false", 2021-07-26T16:03:45.751 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_type": "", 2021-07-26T16:03:45.751 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from_all": "false", 2021-07-26T16:03:45.751 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_from": [], 2021-07-26T16:03:45.752 INFO:teuthology.orchestra.run.smithi111.stdout: "redirect_zone": "" 2021-07-26T16:03:45.752 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.752 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.753 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_targets": [ 2021-07-26T16:03:45.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.753 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "default-placement", 2021-07-26T16:03:45.754 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2021-07-26T16:03:45.754 INFO:teuthology.orchestra.run.smithi111.stdout: "storage_classes": [ 2021-07-26T16:03:45.754 INFO:teuthology.orchestra.run.smithi111.stdout: "STANDARD" 2021-07-26T16:03:45.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T16:03:45.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.755 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.755 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "default-placement", 2021-07-26T16:03:45.755 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T16:03:45.755 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_policy": { 2021-07-26T16:03:45.756 INFO:teuthology.orchestra.run.smithi111.stdout: "groups": [] 2021-07-26T16:03:45.756 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.756 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.757 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2021-07-26T16:03:45.758 INFO:teuthology.orchestra.run.smithi111.stdout: "short_zone_ids": [ 2021-07-26T16:03:45.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.758 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "112afa81-a585-483c-a26d-c230749bfd0c", 2021-07-26T16:03:45.758 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 3535364756 2021-07-26T16:03:45.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.759 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "4501e97d-8506-4dbd-ab21-66d80872cd3a", 2021-07-26T16:03:45.760 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 2230137321 2021-07-26T16:03:45.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2021-07-26T16:03:45.760 INFO:teuthology.orchestra.run.smithi111.stdout: "key": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T16:03:45.761 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 1401765225 2021-07-26T16:03:45.761 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.761 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2021-07-26T16:03:45.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.762 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zonegroup": "test-zonegroup", 2021-07-26T16:03:45.762 INFO:teuthology.orchestra.run.smithi111.stdout: "master_zone": "f3aaa2d4-f6fd-4245-876b-7aefbde85e73", 2021-07-26T16:03:45.762 INFO:teuthology.orchestra.run.smithi111.stdout: "period_config": { 2021-07-26T16:03:45.762 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2021-07-26T16:03:45.763 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T16:03:45.763 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T16:03:45.763 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T16:03:45.764 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T16:03:45.765 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T16:03:45.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.765 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2021-07-26T16:03:45.766 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2021-07-26T16:03:45.766 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2021-07-26T16:03:45.766 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2021-07-26T16:03:45.766 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2021-07-26T16:03:45.767 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2021-07-26T16:03:45.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:03:45.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:03:45.767 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_id": "3a319e75-7fa5-4cca-8f56-1b4e52eed3a0", 2021-07-26T16:03:45.768 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_name": "test-realm", 2021-07-26T16:03:45.768 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 3 2021-07-26T16:03:45.768 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:03:45.768 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-07-26T16:04:45.770 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=tnoxkv-35 2021-07-26T16:04:45.847 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.849 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:45.892 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:45.892 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:45.895 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T16:04:45.887+0000 7fc5f4c5bb00 -1 asok(0x55800c563720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25534.asok': (13) Permission denied 2021-07-26T16:04:45.977 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=0f7fc4e5-d543-4d8a-990f-70c59945239c 2021-07-26T16:04:46.006 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T16:04:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:04:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627315485.797551_80.1", 2021-07-26T16:04:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T16:04:45.797551Z" 2021-07-26T16:04:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T16:04:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:04:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T16:04:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T16:04:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T16:04:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:04:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T16:04:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T16:04:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T16:04:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:04:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T16:04:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T16:04:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T16:04:46.010 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T16:04:46.011 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:46.012 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.013 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:46.053 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:46.053 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:46.255 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:04:46.255 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:04:46.256 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:04:46.256 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:04:46.256 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:04:46.256 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:04:46.257 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:04:46.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:04:46.257 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:04:46.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:04:46.257 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:04:46.258 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:04:46.258 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:04:46.258 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:04:46.258 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:04:46.259 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:04:51.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:51.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:51.262 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:51.528 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:04:51.529 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:04:51.529 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:04:51.529 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:04:51.529 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:04:51.530 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:04:51.530 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:04:51.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:04:51.530 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:04:51.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:04:51.531 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:04:51.531 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:04:51.531 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:04:51.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:04:51.532 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:04:51.533 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:04:56.534 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.536 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:56.798 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:04:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:04:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:04:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:04:56.799 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:04:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:04:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:04:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:04:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:04:56.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:04:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:04:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:04:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:04:56.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:04:56.802 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:04:56.803 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:01.805 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.807 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:01.849 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:01.849 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:02.060 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:02.060 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:02.061 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:02.061 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:02.061 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:02.061 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:02.062 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:02.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:02.062 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:02.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:02.062 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:02.063 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:02.063 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:02.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:02.063 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:02.065 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:07.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:07.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:07.069 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:07.109 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:07.110 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:07.328 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:07.328 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:07.328 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:07.329 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:07.329 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:07.329 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:07.329 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:07.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:07.330 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:07.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:07.330 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:07.331 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:07.331 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:07.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:07.331 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:07.333 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:12.334 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.335 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:12.376 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:12.377 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:12.587 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:12.587 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:12.588 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:12.588 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:12.588 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:12.588 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:12.589 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:12.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:12.589 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:12.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:12.589 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:12.590 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:12.590 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:12.590 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:12.590 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:12.592 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:17.028 INFO:tasks.rgw.c2.client.1.smithi111.stdout:2021-07-26T16:05:17.025+0000 7f6d56ffd700 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:05:17.593 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:17.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:17.595 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:17.636 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:17.637 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:17.840 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:17.840 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:17.840 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:17.841 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:17.842 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:17.843 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:17.843 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:17.844 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:22.846 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:22.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:22.847 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:22.888 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:22.889 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:23.120 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:23.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:23.122 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:23.122 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:23.123 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:23.123 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:23.123 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:23.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:23.123 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:23.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:23.124 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:23.124 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:23.124 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:23.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:23.125 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:23.126 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:28.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:28.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:28.129 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:28.172 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:28.173 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:28.391 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:28.392 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:28.392 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:28.392 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:28.392 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:28.393 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:28.393 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:28.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:28.393 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:28.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:28.394 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:28.394 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:28.394 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:28.395 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:28.395 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:28.396 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:33.397 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:33.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:33.399 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:33.440 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:33.440 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:33.643 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:33.644 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:33.644 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:33.644 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:33.645 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:33.645 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:33.645 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:33.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:33.646 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:33.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:33.647 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:33.647 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:33.647 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:33.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:33.648 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:33.649 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:38.651 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:38.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:38.652 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:38.688 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:38.688 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:38.898 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:38.899 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:38.900 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:38.901 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:38.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:38.902 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:38.903 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:43.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:43.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:43.906 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:43.947 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:44.165 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:44.166 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:44.167 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:44.168 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:44.169 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:44.169 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:44.171 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:49.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:49.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:49.173 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:49.213 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:49.213 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:49.420 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:49.421 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:49.421 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:49.421 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:49.421 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:49.422 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:49.422 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:49.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:49.423 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:49.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:49.424 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:49.424 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:49.424 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:49.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:49.425 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:49.427 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:54.429 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:54.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:54.431 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:54.473 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:54.474 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:54.679 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:54.680 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:54.681 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:54.682 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:54.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:54.684 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:54.686 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:05:59.687 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:59.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:59.689 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:59.955 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:05:59.955 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:05:59.956 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:05:59.956 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:05:59.956 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:05:59.956 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:05:59.956 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:05:59.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:59.957 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:05:59.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:05:59.958 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:05:59.958 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:05:59.958 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:05:59.958 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:05:59.959 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:05:59.960 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:04.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:04.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:04.963 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:05.004 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:05.005 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:05.210 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:05.211 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:05.211 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:05.211 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:05.211 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:05.212 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:05.212 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:05.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:05.212 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:05.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:05.213 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:05.213 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:05.213 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:05.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:05.214 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:05.215 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:10.216 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:10.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:10.217 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:10.257 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:10.257 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:10.469 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:10.469 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:10.470 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:10.470 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:10.470 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:10.470 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:10.471 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:10.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:10.471 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:10.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:10.471 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:10.472 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:10.472 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:10.472 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:10.472 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:10.473 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:15.474 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:15.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:15.476 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:15.518 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:15.518 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:15.722 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:15.725 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:15.726 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:20.728 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:20.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:20.730 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:20.771 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:20.772 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:20.991 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:20.991 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:20.991 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:20.992 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:20.992 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:20.992 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:20.992 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:20.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:20.993 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:20.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:20.993 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:20.993 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:20.994 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:20.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:20.994 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:20.995 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:25.996 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:25.997 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:25.998 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:26.042 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:26.042 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:26.248 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:26.249 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:26.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:26.251 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:26.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:26.252 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:26.253 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:31.255 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:31.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:31.256 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:31.298 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:31.299 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:31.519 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:31.519 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:31.520 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:31.520 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:31.520 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:31.520 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:31.520 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:31.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:31.521 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:31.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:31.521 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:31.522 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:31.522 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:31.522 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:31.522 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:31.523 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:36.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:36.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:36.526 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:36.567 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:36.568 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:36.791 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:36.791 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:36.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:36.793 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:36.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:36.794 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:36.795 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:41.796 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:41.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:41.798 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:41.841 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:41.842 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:42.048 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:42.049 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:42.049 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:42.049 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:42.049 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:42.050 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:42.050 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:42.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:42.051 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:42.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:42.051 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:42.051 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:42.052 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:42.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:42.052 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:42.053 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:47.054 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:47.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:47.056 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:47.096 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:47.097 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:47.315 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:47.316 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:47.318 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:47.319 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:47.319 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:47.320 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:52.322 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:52.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:52.323 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:52.574 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:52.574 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:52.574 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:52.575 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:52.575 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:52.575 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:52.575 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:52.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:52.576 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:52.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:52.576 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:52.577 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:52.577 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:52.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:52.577 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:52.578 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:06:57.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:57.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:57.582 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:57.623 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:57.829 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:06:57.830 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:06:57.830 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:06:57.830 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:06:57.831 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:06:57.831 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:06:57.831 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:06:57.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:57.832 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:06:57.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:06:57.832 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:06:57.832 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:06:57.832 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:06:57.833 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:06:57.833 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:06:57.834 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:02.835 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:02.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:02.837 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:02.877 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:02.877 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:03.103 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:03.104 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:03.105 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:03.106 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:03.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:03.107 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:03.108 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:08.110 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:08.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:08.112 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:08.158 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:08.159 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:08.381 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:08.381 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:08.381 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:08.381 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:08.382 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:08.382 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:08.382 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:08.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:08.383 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:08.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:08.383 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:08.383 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:08.384 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:08.384 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:08.384 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:08.385 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:13.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:13.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:13.389 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:13.430 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:13.430 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:13.661 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:13.662 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:13.662 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:13.662 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:13.663 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:13.663 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:13.663 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:13.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:13.664 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:13.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:13.664 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:13.665 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:13.665 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:13.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:13.665 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:13.667 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:18.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:18.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:18.669 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:18.710 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:18.710 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:18.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:18.941 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:18.942 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:18.943 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:18.944 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:18.945 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:23.946 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:23.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:23.947 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:23.989 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:23.990 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:24.209 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:24.210 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:24.210 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:24.210 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:24.210 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:24.211 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:24.212 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:24.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:24.213 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:24.214 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:29.215 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:29.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:29.217 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:29.473 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:29.473 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:29.474 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:29.475 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:29.476 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:29.476 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:29.477 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:34.479 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:34.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:34.480 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:34.522 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:34.523 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:34.746 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:34.749 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:34.750 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:39.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:39.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:39.753 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:39.793 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:39.794 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:40.023 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:40.027 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:40.028 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:45.029 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:45.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:45.031 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:45.072 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:45.073 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:45.281 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:45.282 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:45.283 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:45.283 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:45.283 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:45.283 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:45.284 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:45.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:45.284 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:45.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:45.285 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:45.285 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:45.285 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:45.285 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:45.286 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:45.287 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:50.289 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:50.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:50.290 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:50.334 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:50.334 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:50.549 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:50.549 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:50.549 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:50.550 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:50.550 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:50.550 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:50.550 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:50.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:50.551 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:50.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:50.552 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:50.552 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:50.552 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:50.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:50.552 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:50.554 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:07:55.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:55.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:55.557 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:55.826 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:07:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:07:55.826 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:07:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:07:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:07:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:07:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:07:55.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:07:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:07:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:07:55.828 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:07:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:07:55.829 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:07:55.829 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:07:55.830 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:00.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:00.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:00.833 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:00.873 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:00.873 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:01.083 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:01.083 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:01.083 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:01.083 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:01.084 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:01.084 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:01.084 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:01.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:01.085 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:01.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:01.085 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:01.086 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:01.086 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:01.086 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:01.086 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:01.087 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:06.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:06.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:06.090 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:06.133 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:06.134 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:06.355 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:06.355 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:06.356 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:06.357 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:06.358 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:06.358 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:06.359 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:11.361 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:11.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:11.362 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:11.404 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:11.404 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:11.629 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:11.629 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:11.630 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:11.630 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:11.630 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:11.630 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:11.630 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:11.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:11.631 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:11.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:11.631 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:11.632 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:11.632 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:11.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:11.632 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:11.633 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:16.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:16.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:16.637 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:16.674 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:16.674 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:16.885 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:16.885 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:16.885 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:16.886 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:16.886 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:16.886 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:16.886 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:16.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:16.887 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:16.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:16.887 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:16.887 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:16.888 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:16.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:16.888 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:16.889 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:21.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:21.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:21.893 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:21.933 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:21.934 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:22.155 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:22.155 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:22.156 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:22.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:22.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:22.159 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:22.160 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:27.161 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:27.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:27.162 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:27.422 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:27.423 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:27.423 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:27.423 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:27.423 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:27.424 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:27.424 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:27.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:27.424 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:27.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:27.425 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:27.425 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:27.425 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:27.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:27.426 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:27.427 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:32.428 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:32.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:32.429 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:32.471 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:32.472 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:32.684 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:32.685 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:32.685 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:32.686 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:32.686 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:32.687 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:32.687 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:32.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:32.688 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:32.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:32.689 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:32.689 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:32.690 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:32.690 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:32.691 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:32.693 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:37.695 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:37.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:37.696 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:37.738 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:37.738 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:37.961 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:37.962 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:37.962 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:37.963 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:37.963 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:37.963 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:37.963 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:37.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:37.964 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:37.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:37.964 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:37.965 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:37.965 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:37.965 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:37.965 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:37.967 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:42.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:42.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:42.969 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:43.010 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:43.010 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:43.219 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:43.219 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:43.220 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:43.220 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:43.220 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:43.220 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:43.221 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:43.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:43.221 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:43.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:43.222 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:43.222 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:43.222 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:43.222 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:43.223 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:43.224 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:48.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:48.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:48.226 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:48.269 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:48.269 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:48.489 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:48.489 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:48.489 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:48.490 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:48.490 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:48.490 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:48.490 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:48.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:48.491 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:48.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:48.491 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:48.492 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:48.492 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:48.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:48.492 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:48.493 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:53.494 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:53.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:53.496 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:53.539 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:53.540 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:53.744 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:53.745 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:53.745 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:53.746 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:53.746 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:53.747 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:53.747 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:53.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:53.748 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:53.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:53.749 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:53.749 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:53.750 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:53.750 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:53.750 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:53.752 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:08:58.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:58.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:58.755 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:58.798 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:58.799 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:08:59.035 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:08:59.036 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:08:59.036 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:08:59.036 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:08:59.036 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:08:59.037 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:08:59.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:59.037 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:08:59.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:08:59.037 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:08:59.038 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:08:59.038 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:08:59.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:08:59.038 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:08:59.040 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:04.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:04.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:04.044 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:04.085 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:04.085 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:04.304 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:04.305 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:04.305 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:04.306 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:04.306 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:04.307 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:04.307 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:04.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:04.308 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:04.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:04.309 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:04.309 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:04.310 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:04.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:04.311 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:04.313 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:09.315 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:09.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:09.316 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:09.358 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:09.359 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:09.590 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:09.591 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:09.591 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:09.591 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:09.591 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:09.592 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:09.592 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:09.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:09.592 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:09.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:09.593 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:09.593 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:09.593 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:09.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:09.594 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:09.595 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:14.596 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:14.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:14.598 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:14.640 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:14.641 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:14.851 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:14.851 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:14.852 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:14.852 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:14.853 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:14.853 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:14.854 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:14.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:14.856 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:14.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:14.857 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:14.857 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:14.858 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:14.858 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:14.859 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:14.861 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:19.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:19.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:19.864 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:19.905 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:19.906 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:20.117 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:20.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:20.118 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:20.118 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:20.118 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:20.119 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:20.119 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:20.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:20.119 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:20.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:20.120 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:20.120 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:20.120 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:20.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:20.121 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:20.122 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:25.123 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:25.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:25.125 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:25.168 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:25.168 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:25.385 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:25.385 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:25.386 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:25.386 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:25.386 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:25.386 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:25.387 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:25.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:25.387 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:25.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:25.387 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:25.388 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:25.388 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:25.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:25.388 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:25.389 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:30.391 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:30.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:30.392 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:30.434 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:30.435 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:30.658 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:30.663 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:30.664 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:35.665 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:35.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:35.666 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:35.709 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:35.709 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:35.912 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:35.913 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:35.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:35.915 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:35.915 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:35.917 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:40.918 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:40.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:40.919 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:40.960 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:40.960 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:41.175 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:41.175 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:41.176 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:41.177 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:41.178 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:41.180 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:46.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:46.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:46.183 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:46.225 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:46.225 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:46.439 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:46.439 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:46.440 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:46.440 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:46.440 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:46.440 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:46.441 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:46.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:46.441 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:46.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:46.442 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:46.442 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:46.442 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:46.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:46.443 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:46.444 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:51.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:51.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:51.447 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:51.489 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:51.490 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:51.699 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:51.702 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:51.703 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:09:56.705 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:56.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:56.707 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:56.748 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:56.748 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:56.968 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:09:56.969 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:09:56.969 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:09:56.969 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:09:56.969 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:09:56.970 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:09:56.970 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:09:56.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:56.970 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:09:56.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:09:56.971 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:09:56.971 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:09:56.971 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:09:56.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:09:56.972 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:09:56.973 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:01.975 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... FAIL 2021-07-26T16:10:01.977 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:01.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:01.978 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:02.021 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:02.022 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:02.025 INFO:teuthology.orchestra.run.smithi018.stderr:2021-07-26T16:10:02.015+0000 7f5e5e378b00 -1 asok(0x55e6b538b720) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/c1-client.0.25622.asok': (13) Permission denied 2021-07-26T16:10:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:No --period given, using current period=0f7fc4e5-d543-4d8a-990f-70c59945239c 2021-07-26T16:10:02.137 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2021-07-26T16:10:02.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:10:02.138 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "1_1627315485.797551_80.1", 2021-07-26T16:10:02.138 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "2021-07-26T16:04:45.797551Z" 2021-07-26T16:10:02.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T16:10:02.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:10:02.139 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T16:10:02.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T16:10:02.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T16:10:02.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:10:02.140 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T16:10:02.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T16:10:02.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2021-07-26T16:10:02.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2021-07-26T16:10:02.141 INFO:teuthology.orchestra.run.smithi018.stdout: "marker": "", 2021-07-26T16:10:02.141 INFO:teuthology.orchestra.run.smithi018.stdout: "last_update": "0.000000" 2021-07-26T16:10:02.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2021-07-26T16:10:02.142 INFO:teuthology.orchestra.run.smithi018.stdout:] 2021-07-26T16:10:02.143 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:10:02.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:02.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:02.145 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:02.185 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:02.186 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:02.397 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:02.403 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:02.404 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:07.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:07.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:07.407 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:07.449 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:07.449 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:07.678 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:07.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:07.681 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:07.681 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:07.681 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:07.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:07.682 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:07.683 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:12.684 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:12.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:12.685 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:12.727 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:12.728 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:12.968 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:12.968 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:12.969 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:12.970 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:12.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:12.971 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:12.972 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:17.973 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:17.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:17.975 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:18.016 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:18.017 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:18.242 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:18.242 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:18.242 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:18.243 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:18.243 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:18.243 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:18.243 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:18.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:18.244 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:18.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:18.244 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:18.245 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:18.245 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:18.245 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:18.245 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:18.247 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:23.248 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:23.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:23.249 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:23.292 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:23.292 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:23.503 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:23.504 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:23.504 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:23.504 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:23.504 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:23.504 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:23.505 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:23.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:23.505 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:23.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:23.506 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:23.506 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:23.506 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:23.506 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:23.506 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:23.508 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:28.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:28.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:28.511 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:28.551 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:28.552 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:28.775 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:28.878 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:28.878 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:28.879 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:28.879 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:28.879 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:28.879 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:28.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:28.880 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:28.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:28.880 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:28.881 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:28.881 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:28.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:28.881 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:28.883 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:33.884 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:33.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:33.885 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:33.930 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:33.930 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:34.143 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:34.144 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:34.145 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:34.146 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:34.149 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:34.150 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:34.151 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:34.152 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:39.153 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:39.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:39.157 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:39.202 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:39.202 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:39.418 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:39.419 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:39.419 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:39.419 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:39.420 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:39.420 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:39.420 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:39.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:39.421 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:39.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:39.421 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:39.421 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:39.421 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:39.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:39.422 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:39.423 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:44.424 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:44.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:44.426 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:44.468 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:44.468 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:44.689 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:44.690 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:44.691 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:44.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:44.693 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:44.694 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:49.695 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:49.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:49.696 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:49.734 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:49.735 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:49.938 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:49.939 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:49.939 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:49.939 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:49.939 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:49.940 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:49.940 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:49.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:49.940 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:49.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:49.941 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:49.941 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:49.941 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:49.942 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:49.942 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:49.943 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:10:54.944 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:54.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:54.945 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:54.987 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:54.987 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:55.215 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:10:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:10:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:10:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:10:55.216 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:10:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:10:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:10:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:55.217 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:10:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:10:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:10:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:10:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:10:55.218 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:10:55.219 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:10:55.220 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:00.221 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:00.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:00.222 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:00.265 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:00.265 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:00.498 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:00.499 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:00.499 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:00.499 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:00.500 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:00.500 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:00.500 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:00.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:00.501 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:00.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:00.501 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:00.501 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:00.501 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:00.502 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:00.502 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:00.503 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:05.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:05.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:05.506 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:05.759 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:05.759 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:05.760 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:05.761 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:05.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:05.762 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:05.763 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:10.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:10.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:10.766 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:10.807 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:10.807 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:11.014 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:11.014 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:11.014 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:11.015 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:11.016 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:11.016 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:11.016 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:11.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:11.017 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:11.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:11.017 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:11.017 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:11.018 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:11.018 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:11.018 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:11.020 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:16.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:16.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:16.022 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:16.069 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:16.069 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:16.287 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:16.288 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:16.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:16.290 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:16.291 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:16.291 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:16.292 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:21.293 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:21.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:21.295 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:21.337 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:21.338 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:21.553 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:21.553 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:21.553 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:21.553 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:21.554 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:21.554 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:21.554 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:21.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:21.555 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:21.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:21.555 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:21.555 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:21.555 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:21.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:21.556 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:21.557 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:26.558 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:26.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:26.560 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:26.601 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:26.602 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:26.809 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:26.809 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:26.810 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:26.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:26.812 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:26.812 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:26.814 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:31.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:31.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:31.818 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:31.860 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:31.860 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:32.093 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:32.094 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:32.094 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:32.094 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:32.095 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:32.095 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:32.095 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:32.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:32.095 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:32.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:32.096 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:32.096 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:32.096 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:32.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:32.097 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:32.098 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:37.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:37.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:37.101 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:37.142 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:37.143 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:37.366 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:37.366 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:37.366 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:37.367 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:37.367 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:37.367 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:37.367 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:37.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:37.368 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:37.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:37.368 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:37.369 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:37.369 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:37.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:37.369 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:37.370 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:42.372 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:42.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:42.373 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:42.628 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:42.629 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:42.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:42.631 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:42.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:42.632 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:42.633 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:47.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:47.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:47.636 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:47.681 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:47.682 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:47.890 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:47.891 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:47.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:47.893 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:47.894 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:47.895 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:52.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:52.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:52.898 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:52.942 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:52.943 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:53.164 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:53.167 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:53.168 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:11:58.170 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:58.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:11:58.171 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:11:58.213 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:11:58.213 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:11:58.436 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:11:58.437 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:11:58.437 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:11:58.437 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:11:58.438 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:11:58.438 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:11:58.438 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:11:58.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:58.439 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:11:58.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:11:58.439 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:11:58.439 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:11:58.439 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:11:58.440 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:11:58.440 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:11:58.441 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:03.444 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:03.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:03.446 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:03.489 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:03.489 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:03.719 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:03.719 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:03.720 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:03.720 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:03.721 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:03.721 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:03.722 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:03.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:03.723 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:03.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:03.723 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:03.724 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:03.724 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:03.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:03.725 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:03.727 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:08.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:08.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:08.731 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:08.774 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:08.774 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:09.001 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:09.001 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:09.002 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:09.002 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:09.002 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:09.002 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:09.003 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:09.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:09.003 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:09.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:09.003 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:09.004 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:09.004 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:09.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:09.004 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:09.006 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:14.007 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:14.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:14.009 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:14.049 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:14.049 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:14.261 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:14.262 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:14.262 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:14.262 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:14.262 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:14.263 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:14.263 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:14.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:14.263 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:14.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:14.264 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:14.264 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:14.264 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:14.264 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:14.265 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:14.266 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:19.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:19.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:19.269 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:19.310 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:19.310 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:19.540 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:19.541 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:19.541 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:19.541 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:19.541 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:19.542 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:19.542 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:19.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:19.542 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:19.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:19.543 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:19.543 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:19.543 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:19.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:19.544 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:19.545 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:24.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:24.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:24.548 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:24.819 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:24.820 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:24.820 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:24.820 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:24.821 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:24.821 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:24.821 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:24.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:24.821 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:24.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:24.822 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:24.822 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:24.822 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:24.823 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:24.823 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:24.824 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:29.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:29.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:29.827 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:29.869 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:29.869 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:30.088 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:30.092 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:30.094 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:35.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:35.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:35.097 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:35.139 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:35.140 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:35.348 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:35.349 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:35.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:35.351 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:35.352 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:35.353 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:40.354 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:40.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:40.355 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:40.397 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:40.397 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:40.616 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:40.616 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:40.617 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:40.617 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:40.617 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:40.618 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:40.618 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:40.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:40.619 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:40.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:40.620 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:40.621 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:40.621 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:40.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:40.622 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:40.624 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:45.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:45.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:45.627 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:45.868 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:45.868 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:45.868 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:45.868 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:45.869 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:45.869 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:45.869 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:45.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:45.870 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:45.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:45.870 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:45.870 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:45.871 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:45.871 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:45.871 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:45.872 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:50.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:50.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:50.875 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:50.917 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:50.917 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:51.137 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:51.138 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:51.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:51.140 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:51.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:51.141 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:51.142 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:12:56.143 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:56.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:12:56.145 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:12:56.184 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:12:56.185 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:12:56.409 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:12:56.409 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:12:56.409 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:12:56.409 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:12:56.410 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:12:56.410 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:12:56.410 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:12:56.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:56.411 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:12:56.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:12:56.411 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:12:56.411 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:12:56.412 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:12:56.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:12:56.412 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:12:56.413 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:01.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:01.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:01.416 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:13:01.456 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:13:01.456 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:01.684 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:13:01.685 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:13:01.685 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:13:01.685 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:13:01.686 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:13:01.686 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:13:01.686 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:13:01.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:01.687 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:13:01.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:01.687 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:13:01.687 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:13:01.688 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:13:01.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:13:01.688 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:13:01.689 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:06.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:06.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:06.692 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:13:06.731 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:13:06.732 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:06.962 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:13:06.963 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:13:06.963 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:13:06.963 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:13:06.964 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:13:06.964 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:13:06.964 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:13:06.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:06.964 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:13:06.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:06.965 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:13:06.965 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:13:06.965 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:13:06.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:13:06.966 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:13:06.967 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:11.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:11.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:11.970 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:13:12.011 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:13:12.011 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:12.244 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:13:12.245 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:13:12.245 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:13:12.246 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:13:12.246 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:13:12.246 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:13:12.246 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:13:12.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:12.247 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:13:12.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:12.247 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:13:12.247 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:13:12.248 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:13:12.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:13:12.248 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:13:12.249 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:17.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:17.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:17.252 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:13:17.294 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:13:17.294 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:17.515 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:13:17.516 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:13:17.516 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:13:17.516 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:13:17.517 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:13:17.517 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:13:17.517 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:13:17.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:17.518 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:13:17.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:17.518 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:13:17.518 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:13:17.519 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:13:17.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:13:17.519 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:13:17.520 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:22.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:22.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:22.523 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:13:22.563 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:13:22.564 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:22.767 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:13:22.813 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:13:22.813 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:13:22.813 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:13:22.814 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:13:22.814 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:13:22.814 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:13:22.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:22.815 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:13:22.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:22.815 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:13:22.815 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:13:22.815 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:13:22.816 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:13:22.816 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:13:22.817 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:27.818 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:27.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:13:27.820 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:13:27.861 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:13:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:28.091 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2021-07-26T16:13:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "sync_status": { 2021-07-26T16:13:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2021-07-26T16:13:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "status": "init", 2021-07-26T16:13:28.092 INFO:teuthology.orchestra.run.smithi111.stdout: "num_shards": 0, 2021-07-26T16:13:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "period": "", 2021-07-26T16:13:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "realm_epoch": 0 2021-07-26T16:13:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:28.093 INFO:teuthology.orchestra.run.smithi111.stdout: "markers": [] 2021-07-26T16:13:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2021-07-26T16:13:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "full_sync": { 2021-07-26T16:13:28.094 INFO:teuthology.orchestra.run.smithi111.stdout: "total": 0, 2021-07-26T16:13:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: "complete": 0 2021-07-26T16:13:28.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2021-07-26T16:13:28.095 INFO:teuthology.orchestra.run.smithi111.stdout:} 2021-07-26T16:13:28.097 WARNING:rgw_multi.tests:zone test-zone2 is syncing realm epoch=0, behind current realm epoch=3 2021-07-26T16:13:30.368 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-07-26T16:13:30.370 DEBUG:teuthology.task.console_log:Killing console logger for smithi018 2021-07-26T16:13:30.371 DEBUG:teuthology.task.console_log:Killing console logger for smithi111 2021-07-26T16:13:30.371 DEBUG:teuthology.exit:Finished running handlers